Feb 26 02:56:53 devstack cinder-volume[73298]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 02:56:53 devstack cinder-volume[73298]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 02:56:53 devstack cinder-volume[73298]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 02:56:53 devstack cinder-volume[73298]: INFO dbcounter [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Registered counter for database cinder Feb 26 02:56:53 devstack cinder-volume[73298]: DEBUG oslo_db.sqlalchemy.engines [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 02:56:53 devstack cinder-volume[73298]: DEBUG dbcounter [-] [73298] Writer thread running {{(pid=73298) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 02:56:53 devstack cinder-volume[73298]: INFO cinder.rpc [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 26 02:56:53 devstack cinder-volume[73298]: INFO cinder.rpc [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 26 02:56:53 devstack cinder-volume[73298]: DEBUG oslo_db.sqlalchemy.engines [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 02:56:53 devstack cinder-volume[73298]: INFO cinder.volume.manager [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Determined volume DB was empty at startup. Feb 26 02:56:53 devstack cinder-volume[73298]: DEBUG cinder.volume.manager [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73298) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 26 02:56:53 devstack cinder-volume[73298]: INFO cinder.volume.manager [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 26 02:56:53 devstack cinder-volume[73298]: WARNING stevedore.named [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 26 02:56:53 devstack cinder-volume[73298]: WARNING castellan.key_manager [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 02:56:53 devstack cinder-volume[73298]: WARNING cinder.keymgr.conf_key_mgr [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 02:56:53 devstack cinder-volume[73298]: DEBUG cinder.volume.drivers.lvm [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73298) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 26 02:56:53 devstack cinder-volume[73298]: DEBUG oslo_concurrency.processutils [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_concurrency.processutils [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] CMD "cinder-rtstool verify" returned: 0 in 0.250s {{(pid=73298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_db.sqlalchemy.engines [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 02:56:54 devstack cinder-volume[73298]: INFO cinder.rpc [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 26 02:56:54 devstack cinder-volume[73298]: INFO cinder.rpc [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 26 02:56:54 devstack cinder-volume[73298]: WARNING stevedore.named [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 26 02:56:54 devstack cinder-volume[73298]: WARNING castellan.key_manager [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 02:56:54 devstack cinder-volume[73298]: INFO cinder.volume.manager [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_db.sqlalchemy.engines [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 02:56:54 devstack cinder-volume[73298]: INFO oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Starting 1 workers Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Started child 73398 {{(pid=73298) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Full set of CONF: {{(pid=73298) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] ******************************************************************************** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Configuration options gathered from: {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] ================================================================================ {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] allow_availability_zone_fallback = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] allow_compression_on_image_upload = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] allowed_direct_url_schemes = [] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] api_rate_limit = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] auth_strategy = keystone {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] az_cache_duration = 3600 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_availability_zone = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_host = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_name = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_stats_polling_interval = 60 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backup_api_class = cinder.backup.api.API {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73398]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backup_name_template = backup-%s {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backup_use_same_host = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backup_use_temp_snapshot = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] chap_password = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] chap_username = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cinder_internal_tenant_project_id = d7f84376aac4432ab7004abc417888f9 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cinder_internal_tenant_user_id = c54cb05084844480920a4a16d77cac35 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cloned_volume_same_az = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cluster = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] compression_format = gzip {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] compute_api_class = cinder.compute.nova.API {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] config_dir = [] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] config_source = [] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] control_exchange = openstack {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] debug = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] default_availability_zone = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] default_group_type = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] default_volume_type = lvmdriver-1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] disk_geometry = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] driver_client_cert = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] driver_client_cert_key = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] driver_data_namespace = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] driver_ssl_cert_path = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] driver_ssl_cert_verify = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] driver_use_ssl = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] enable_force_upload = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] enable_new_services = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] enable_unsupported_driver = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] enforce_multipath_for_image_xfer = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] filter_function = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance_api_insecure = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance_api_servers = ['http://192.168.122.78/image'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance_api_ssl_compression = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance_ca_certificates_file = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance_catalog_info = image:glance:publicURL {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance_certfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance_keyfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance_num_retries = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance_request_timeout = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] goodness_function = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] graceful_shutdown_timeout = 5 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] group_api_class = cinder.group.api.API {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] host = devstack {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] image_compress_on_upload = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] image_conversion_address_space_limit = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] image_conversion_cpu_limit = 60 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] image_conversion_disable = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] image_upload_use_cinder_backend = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] image_upload_use_internal_tenant = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] image_volume_cache_enabled = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] image_volume_cache_max_count = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] image_volume_cache_max_size_gb = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] init_host_max_objects_retrieval = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] instance_format = [instance: %(uuid)s] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] iscsi_target_flags = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] iscsi_write_cache = on {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] iser_helper = tgtadm {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] iser_ip_address = 192.168.122.78 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] iser_port = 3260 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] log_color = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] log_config_append = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] log_dir = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] log_file = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] log_options = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] log_rotate_interval = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] log_rotate_interval_type = days {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] log_rotation_type = none {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] max_age = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] max_logfile_count = 30 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] max_logfile_size_mb = 200 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] max_over_subscription_ratio = 20.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] message_reap_interval = 86400 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] message_ttl = 2592000 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] migration_create_volume_timeout_secs = 300 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] monkey_patch = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] monkey_patch_modules = [] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] my_ip = 192.168.122.78 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] no_snapshot_gb_quota = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] num_iser_scan_tries = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] num_shell_tries = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] num_volume_device_scan_tries = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] nvmeof_conn_info_version = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] nvmet_ns_id = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] nvmet_port_id = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] osapi_max_limit = 1000 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] osapi_volume_ext_list = [] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] osapi_volume_listen_port = 8776 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] osapi_volume_use_ssl = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] osapi_volume_workers = 2 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] per_volume_size_limit = -1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] periodic_fuzzy_delay = 60 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] periodic_interval = 60 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] public_endpoint = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] publish_errors = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] quota_backup_gigabytes = 1000 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] quota_backups = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] quota_gigabytes = 1000 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] quota_groups = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] quota_snapshots = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] quota_volumes = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] rate_limit_burst = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] rate_limit_except_level = CRITICAL {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] rate_limit_interval = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] reinit_driver_count = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] replication_device = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] report_discard_supported = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] report_interval = 120 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] reservation_clean_interval = 86400 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] reservation_expire = 86400 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] reserved_image_namespaces = [] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] reserved_percentage = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] rpc_response_timeout = 120 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] run_external_periodic_tasks = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] scst_target_driver = iscsi {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] scst_target_iqn_name = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_down_time = 720 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] shell_completion = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] snapshot_name_template = snapshot-%s {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] snapshot_same_host = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] split_loggers = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] state_path = /opt/stack/data/cinder {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] storage_availability_zone = nova {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] storage_protocol = iSCSI {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] syslog_log_facility = LOG_USER {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] target_helper = lioadm {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] target_ip_address = 192.168.122.78 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] target_port = 3260 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] target_protocol = iscsi {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] target_secondary_ip_addresses = [] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] trace_flags = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] transport_url = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] until_refresh = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] use_chap_auth = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] use_default_quota_class = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] use_journal = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73398]: INFO cinder.volume.manager [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] use_json = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] use_multipath_for_image_xfer = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] use_stderr = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] use_syslog = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] verify_glance_signatures = enabled {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_api_class = cinder.volume.api.API {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_backend_name = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_clear = zero {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_clear_ionice = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_clear_size = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_copy_bps_limit = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_dd_blocksize = 1M {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_name_template = volume-%s {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_service_inithost_offload = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volume_usage_audit_period = month {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] zoning_mode = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_concurrency.disable_process_locking = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.admin_password = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.admin_token = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.admin_user = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.auth_port = 35357 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.auth_protocol = https {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.auth_section = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.auth_type = password {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.auth_uri = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.auth_version = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.cache = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.certfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.identity_uri = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.include_service_catalog = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.insecure = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.interface = public {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.keyfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_password = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcache_username = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.region_name = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.service_type = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.78/identity {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.backend = dogpile.cache.null {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.backend_argument = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.backend_expiration_time = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.config_prefix = cache.oslo {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.debug_cache_backend = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.enable_retry_client = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.enable_socket_keepalive = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.enabled = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.enforce_fips_mode = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.expiration_time = 600 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.hashclient_retry_attempts = 2 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.memcache_dead_retry = 300 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.memcache_pool_maxsize = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.memcache_sasl_enabled = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.password = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.proxies = [] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.redis_db = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.redis_server = localhost:6379 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.retry_attempts = 2 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.retry_delay = 0.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.socket_keepalive_count = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.socket_keepalive_idle = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.socket_keepalive_interval = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.socket_timeout = 1.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.tls_allowed_ciphers = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.tls_cafile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.tls_certfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.tls_enabled = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.tls_keyfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cache.username = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] coordination.backend_url = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.asyncio_connection = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.asyncio_slave_connection = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.backend = sqlalchemy {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.connection = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.connection_debug = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.connection_parameters = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.connection_recycle_time = 3600 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.connection_trace = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.db_inc_retry_interval = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.db_max_retries = 20 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.db_max_retry_interval = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.db_retry_interval = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.max_overflow = 50 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.max_pool_size = 5 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.max_retries = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.mysql_wsrep_sync_wait = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.pool_timeout = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.retry_interval = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.slave_connection = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.sqlite_synchronous = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.synchronous_reader = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] database.use_db_reconnect = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.connection_string = messaging:// {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.enabled = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.es_doc_type = notification {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.es_scroll_size = 10000 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.es_scroll_time = 2m {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.filter_error_trace = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.hmac_keys = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.sentinel_service_name = mymaster {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.socket_timeout = 0.1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.trace_requests = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler.trace_sqlalchemy = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler_jaeger.process_tags = {} {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler_jaeger.service_name_prefix = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] profiler_otlp.service_name_prefix = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.enforce_new_defaults = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:54 devstack cinder-volume[73298]: WARNING oslo_config.cfg [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.enforce_scope = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.policy_default_rule = default {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.policy_file = policy.yaml {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] privsep_osbrick.group = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] privsep_osbrick.helper_command = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] privsep_osbrick.user = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cinder_sys_admin.group = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cinder_sys_admin.helper_command = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] cinder_sys_admin.user = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_user.auth_section = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_user.auth_type = password {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_user.cafile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_user.certfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_user.collect_timing = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_user.insecure = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_user.keyfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_user.send_service_user_token = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_user.split_loggers = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] service_user.timeout = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance.auth_section = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance.auth_type = password {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance.certfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance.collect_timing = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance.insecure = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance.keyfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance.region_name = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance.split_loggers = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] glance.timeout = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.backend_availability_zone = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.chap_password = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.chap_username = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.disk_geometry = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.driver_client_cert = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.driver_client_cert_key = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.driver_data_namespace = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.driver_use_ssl = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.extra_capabilities = {} {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.filter_function = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.goodness_function = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.iscsi_target_flags = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.iscsi_write_cache = on {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.iser_helper = tgtadm {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.iser_ip_address = 192.168.122.78 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.iser_port = 3260 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.lvm_share_target = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.lvm_type = auto {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.num_shell_tries = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.replication_device = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.report_discard_supported = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.reserved_percentage = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.target_helper = tgtadm {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.target_ip_address = 192.168.122.78 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.target_port = 3260 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.target_protocol = iscsi {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.trace_flags = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.unique_fqdn_network = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.use_chap_auth = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.volume_backend_name = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.volume_clear = zero {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.volume_clear_ionice = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.volume_clear_size = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_reports.file_event_handler = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_reports.log_dir = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.backend_host = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.chap_password = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.chap_username = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.disk_geometry = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.driver_client_cert = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.extra_capabilities = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.filter_function = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.goodness_function = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.iser_helper = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.iser_ip_address = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.iser_port = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.lvm_share_target = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.lvm_type = auto {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.num_shell_tries = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.replication_device = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.report_discard_supported = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.reserved_percentage = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.scst_target_driver = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.storage_protocol = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.target_helper = lioadm {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.target_ip_address = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.target_port = 3260 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.trace_flags = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.use_chap_auth = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.volume_clear = zero {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.volume_clear_size = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] lvmdriver-1.volumes_dir = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.ssl = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_notifications.driver = [] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_notifications.retry = -1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] key_manager.fixed_key = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.barbican_api_version = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.barbican_endpoint = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.barbican_endpoint_type = public {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.barbican_region_name = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.cafile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.certfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.collect_timing = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.insecure = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.keyfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.number_of_retries = 60 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.retry_delay = 1 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.send_service_user_token = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.split_loggers = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.timeout = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.verify_ssl = True {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican.verify_ssl_path = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican_service_user.auth_section = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican_service_user.auth_type = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican_service_user.cafile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican_service_user.certfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican_service_user.collect_timing = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican_service_user.insecure = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican_service_user.keyfile = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican_service_user.split_loggers = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] barbican_service_user.timeout = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.approle_role_id = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.approle_secret_id = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.kv_mountpoint = secret {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.kv_path = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.kv_version = 2 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.namespace = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.root_token_id = **** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.ssl_ca_crt_file = None {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.timeout = 60.0 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.use_ssl = False {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 02:56:54 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] ******************************************************************************** {{(pid=73298) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 26 02:56:54 devstack sudo[73408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 26 02:56:54 devstack sudo[73408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:56:54 devstack sudo[73408]: pam_unix(sudo:session): session closed for user root Feb 26 02:56:54 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:54 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:54 devstack sudo[73490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:56:54 devstack sudo[73490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:56:55 devstack sudo[73490]: pam_unix(sudo:session): session closed for user root Feb 26 02:56:55 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.536s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:55 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 02:56:55 devstack cinder-volume[73398]: INFO cinder.brick.local_dev.lvm [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 26 02:56:55 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:55 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:55 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:55 devstack sudo[73712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 02:56:55 devstack sudo[73712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:56:56 devstack sudo[73712]: pam_unix(sudo:session): session closed for user root Feb 26 02:56:56 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.507s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:56 devstack cinder-volume[73398]: DEBUG cinder.brick.local_dev.lvm [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73398) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 26 02:56:56 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:56 devstack sudo[73890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:56:56 devstack sudo[73890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:56:56 devstack sudo[73890]: pam_unix(sudo:session): session closed for user root Feb 26 02:56:56 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.977s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:56 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:57 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:57 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:57 devstack sudo[74054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:56:57 devstack sudo[74054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:56:57 devstack sudo[74054]: pam_unix(sudo:session): session closed for user root Feb 26 02:56:57 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:57 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:57 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:57 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:57 devstack sudo[74093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 26 02:56:57 devstack sudo[74093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:56:57 devstack sudo[74093]: pam_unix(sudo:session): session closed for user root Feb 26 02:56:57 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.435s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:57 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:57 devstack sudo[74096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 02:56:57 devstack sudo[74096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:56:58 devstack sudo[74096]: pam_unix(sudo:session): session closed for user root Feb 26 02:56:58 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:58 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:58 devstack sudo[74104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 02:56:58 devstack sudo[74104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:56:58 devstack sudo[74104]: pam_unix(sudo:session): session closed for user root Feb 26 02:56:58 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:58 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:58 devstack sudo[74107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:56:58 devstack sudo[74107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:56:59 devstack sudo[74107]: pam_unix(sudo:session): session closed for user root Feb 26 02:56:59 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:59 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:59 devstack sudo[74112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:56:59 devstack sudo[74112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:56:59 devstack sudo[74112]: pam_unix(sudo:session): session closed for user root Feb 26 02:56:59 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:59 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:59 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:56:59 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:56:59 devstack sudo[74116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:56:59 devstack sudo[74116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:00 devstack sudo[74116]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:00 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:00 devstack cinder-volume[73398]: INFO cinder.volume.drivers.lvm [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 26 02:57:00 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:00 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:00 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:00 devstack sudo[74128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:57:00 devstack sudo[74128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:00 devstack sudo[74128]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:00 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:00 devstack cinder-volume[73398]: DEBUG cinder.volume.drivers.lvm [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Updating volume stats {{(pid=73398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 02:57:00 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:00 devstack sudo[74240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 02:57:00 devstack sudo[74240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:01 devstack sudo[74240]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:01 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:01 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:01 devstack sudo[74244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:57:01 devstack sudo[74244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:01 devstack sudo[74244]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:01 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:01 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:01 devstack sudo[74382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:57:01 devstack sudo[74382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:02 devstack sudo[74382]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:02 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:02 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:02 devstack sudo[74388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:57:02 devstack sudo[74388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:02 devstack sudo[74388]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:02 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:02 devstack cinder-volume[73398]: INFO cinder.volume.driver [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Driver hasn't implemented _init_vendor_properties() Feb 26 02:57:02 devstack cinder-volume[73398]: DEBUG cinder.volume.driver [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73398) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 26 02:57:02 devstack cinder-volume[73398]: DEBUG oslo_db.sqlalchemy.engines [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 02:57:02 devstack cinder-volume[73398]: DEBUG dbcounter [-] [73398] Writer thread running {{(pid=73398) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 02:57:02 devstack cinder-volume[73398]: DEBUG cinder.db.sqlalchemy.api [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Building query based on filter {{(pid=73398) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 26 02:57:02 devstack cinder-volume[73398]: DEBUG cinder.image.image_utils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73398) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 26 02:57:02 devstack cinder-volume[73398]: INFO cinder.keymgr.migration [None req-0d6a194e-5d25-40b9-ac6f-a079ea52a7aa None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 26 02:57:02 devstack cinder-volume[73398]: DEBUG cinder.volume.drivers.lvm [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Updating volume stats {{(pid=73398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 02:57:02 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:02 devstack sudo[74392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 02:57:02 devstack sudo[74392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:03 devstack sudo[74392]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:03 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:03 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:03 devstack sudo[74396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:57:03 devstack sudo[74396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:03 devstack sudo[74396]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:03 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:03 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:03 devstack sudo[74399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:57:03 devstack sudo[74399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:03 devstack sudo[74399]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:03 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:03 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:03 devstack sudo[74405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:57:03 devstack sudo[74405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:04 devstack cinder-volume[73298]: DEBUG dbcounter [-] [73298] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73298) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 02:57:04 devstack sudo[74405]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:04 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:04 devstack cinder-volume[73398]: DEBUG cinder.manager [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Notifying Schedulers of capabilities ... {{(pid=73398) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 02:57:04 devstack cinder-volume[73398]: INFO cinder.volume.manager [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Driver initialization completed successfully. Feb 26 02:57:04 devstack cinder-volume[73398]: INFO cinder.manager [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Initiating service 2 cleanup Feb 26 02:57:04 devstack cinder-volume[73398]: INFO cinder.manager [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Service 2 cleanup completed. Feb 26 02:57:04 devstack cinder-volume[73398]: DEBUG cinder.service [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Creating RPC server for service cinder-volume {{(pid=73398) start /opt/stack/cinder/cinder/service.py:231}} Feb 26 02:57:04 devstack cinder-volume[73398]: DEBUG cinder.service [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73398) start /opt/stack/cinder/cinder/service.py:237}} Feb 26 02:57:04 devstack cinder-volume[73398]: INFO cinder.volume.manager [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 26 02:57:04 devstack cinder-volume[73398]: DEBUG cinder.volume.drivers.lvm [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Updating volume stats {{(pid=73398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 02:57:04 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:04 devstack sudo[74447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 02:57:04 devstack sudo[74447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:04 devstack sudo[74447]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:04 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:04 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:05 devstack sudo[74451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:57:05 devstack sudo[74451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:05 devstack sudo[74451]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:05 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:05 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:05 devstack sudo[74509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:57:05 devstack sudo[74509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:05 devstack sudo[74509]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:05 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:05 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:57:05 devstack sudo[74512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:57:05 devstack sudo[74512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:57:06 devstack sudo[74512]: pam_unix(sudo:session): session closed for user root Feb 26 02:57:06 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:57:06 devstack cinder-volume[73398]: INFO cinder.volume.manager [None req-b876f177-cea0-4e82-a2fc-59c5e8d72abe None None] Driver post RPC initialization completed successfully. Feb 26 02:57:16 devstack cinder-volume[73398]: DEBUG dbcounter [-] [73398] Writing DB stats cinder:SELECT=5 {{(pid=73398) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 02:57:16 devstack cinder-volume[73398]: DEBUG dbcounter [-] [73398] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73398) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 02:58:09 devstack cinder-volume[73398]: DEBUG oslo_service.periodic_task [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73398) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 02:58:09 devstack cinder-volume[73398]: DEBUG cinder.volume.drivers.lvm [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Updating volume stats {{(pid=73398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 02:58:09 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:58:09 devstack sudo[78720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 02:58:09 devstack sudo[78720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:58:09 devstack sudo[78720]: pam_unix(sudo:session): session closed for user root Feb 26 02:58:09 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:58:09 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:58:09 devstack sudo[79020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:58:09 devstack sudo[79020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:58:10 devstack sudo[79020]: pam_unix(sudo:session): session closed for user root Feb 26 02:58:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:58:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:58:10 devstack sudo[79328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:58:10 devstack sudo[79328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:58:10 devstack sudo[79328]: pam_unix(sudo:session): session closed for user root Feb 26 02:58:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:58:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:58:10 devstack sudo[79404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:58:10 devstack sudo[79404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:58:11 devstack sudo[79404]: pam_unix(sudo:session): session closed for user root Feb 26 02:58:11 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:58:11 devstack cinder-volume[73398]: DEBUG cinder.manager [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Notifying Schedulers of capabilities ... {{(pid=73398) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 02:59:09 devstack cinder-volume[73398]: DEBUG oslo_service.periodic_task [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73398) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 02:59:09 devstack cinder-volume[73398]: DEBUG cinder.volume.drivers.lvm [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Updating volume stats {{(pid=73398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 02:59:09 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:59:09 devstack sudo[80307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 02:59:09 devstack sudo[80307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:59:09 devstack sudo[80307]: pam_unix(sudo:session): session closed for user root Feb 26 02:59:09 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:59:09 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:59:09 devstack sudo[80322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:59:09 devstack sudo[80322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:59:10 devstack sudo[80322]: pam_unix(sudo:session): session closed for user root Feb 26 02:59:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:59:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:59:10 devstack sudo[80326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 02:59:10 devstack sudo[80326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:59:10 devstack sudo[80326]: pam_unix(sudo:session): session closed for user root Feb 26 02:59:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.412s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:59:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 02:59:10 devstack sudo[80329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 02:59:10 devstack sudo[80329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 02:59:11 devstack sudo[80329]: pam_unix(sudo:session): session closed for user root Feb 26 02:59:11 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 02:59:11 devstack cinder-volume[73398]: DEBUG cinder.manager [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Notifying Schedulers of capabilities ... {{(pid=73398) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 02:59:16 devstack cinder-volume[73398]: DEBUG dbcounter [-] [73398] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73398) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:00:09 devstack cinder-volume[73398]: DEBUG oslo_service.periodic_task [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73398) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:00:09 devstack cinder-volume[73398]: DEBUG cinder.volume.drivers.lvm [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Updating volume stats {{(pid=73398) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 03:00:09 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:09 devstack sudo[81954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 03:00:09 devstack sudo[81954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:09 devstack sudo[81954]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:09 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:09 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:09 devstack sudo[82011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 03:00:09 devstack sudo[82011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:10 devstack sudo[82011]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:10 devstack sudo[82032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 03:00:10 devstack sudo[82032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:10 devstack sudo[82032]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.408s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:10 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:10 devstack sudo[82039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 03:00:10 devstack sudo[82039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:11 devstack sudo[82039]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:11 devstack cinder-volume[73398]: DEBUG oslo_concurrency.processutils [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=73398) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:11 devstack cinder-volume[73398]: DEBUG cinder.manager [None req-c55ee6c9-2458-4ed5-a0ef-7ed128885a21 None None] Notifying Schedulers of capabilities ... {{(pid=73398) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:00:32 devstack cinder-volume[73298]: INFO oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Caught SIGTERM, stopping children Feb 26 03:00:32 devstack cinder-volume[73298]: DEBUG oslo_concurrency.lockutils [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Acquiring lock "singleton_lock" {{(pid=73298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 03:00:32 devstack cinder-volume[73298]: DEBUG oslo_concurrency.lockutils [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Acquired lock "singleton_lock" {{(pid=73298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 03:00:32 devstack cinder-volume[73298]: DEBUG oslo_concurrency.lockutils [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Releasing lock "singleton_lock" {{(pid=73298) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 03:00:32 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Stop services. {{(pid=73298) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 26 03:00:32 devstack cinder-volume[73298]: DEBUG oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Killing children. {{(pid=73298) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 26 03:00:32 devstack cinder-volume[73298]: INFO oslo_service.backend._eventlet.service [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Waiting on 1 children to exit Feb 26 03:00:37 devstack cinder-volume[73398]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Feb 26 03:00:39 devstack cinder-volume[73398]: DEBUG oslo_concurrency.lockutils [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Acquiring lock "singleton_lock" {{(pid=73398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 03:00:39 devstack cinder-volume[73398]: DEBUG oslo_concurrency.lockutils [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Acquired lock "singleton_lock" {{(pid=73398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 03:00:39 devstack cinder-volume[73398]: DEBUG oslo_concurrency.lockutils [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Releasing lock "singleton_lock" {{(pid=73398) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 03:00:39 devstack cinder-volume[73398]: WARNING amqp [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 26 03:00:39 devstack cinder-volume[73398]: WARNING amqp [None req-9063e969-91b1-40c3-9d35-410be9734f12 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 26 03:00:39 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 03:00:39 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 03:00:39 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 03:00:40 devstack cinder-volume[82624]: INFO dbcounter [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Registered counter for database cinder Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_db.sqlalchemy.engines [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG dbcounter [-] [82624] Writer thread running {{(pid=82624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 03:00:40 devstack cinder-volume[82624]: INFO cinder.rpc [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 26 03:00:40 devstack cinder-volume[82624]: INFO cinder.rpc [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_db.sqlalchemy.engines [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 03:00:40 devstack cinder-volume[82624]: INFO cinder.volume.manager [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Determined volume DB was empty at startup. Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG cinder.volume.manager [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82624) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 26 03:00:40 devstack cinder-volume[82624]: INFO cinder.volume.manager [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 26 03:00:40 devstack cinder-volume[82624]: WARNING stevedore.named [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 26 03:00:40 devstack cinder-volume[82624]: WARNING castellan.key_manager [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 03:00:40 devstack cinder-volume[82624]: WARNING cinder.keymgr.conf_key_mgr [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 03:00:40 devstack cinder-volume[82624]: INFO cinder.volume.manager [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_db.sqlalchemy.engines [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 03:00:40 devstack cinder-volume[82624]: INFO oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Starting 1 workers Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Started child 82739 {{(pid=82624) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Full set of CONF: {{(pid=82624) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] ******************************************************************************** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Configuration options gathered from: {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] ================================================================================ {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] allow_availability_zone_fallback = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] allow_compression_on_image_upload = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] allowed_direct_url_schemes = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] api_rate_limit = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] auth_strategy = keystone {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_availability_zone = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_host = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_stats_polling_interval = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backup_api_class = cinder.backup.api.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backup_name_template = backup-%s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backup_use_same_host = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backup_use_temp_snapshot = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] chap_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] chap_username = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cinder_internal_tenant_project_id = d7f84376aac4432ab7004abc417888f9 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cinder_internal_tenant_user_id = c54cb05084844480920a4a16d77cac35 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cluster = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] compression_format = gzip {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] compute_api_class = cinder.compute.nova.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] config_dir = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] config_source = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] control_exchange = openstack {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] debug = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82739]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] default_availability_zone = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] default_group_type = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] default_volume_type = QuobyteHD {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] disk_geometry = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] driver_client_cert = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] driver_client_cert_key = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] driver_data_namespace = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] driver_ssl_cert_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] driver_ssl_cert_verify = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] driver_use_ssl = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] enable_new_services = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] enable_unsupported_driver = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] enabled_backends = ['QuobyteHD'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] enforce_multipath_for_image_xfer = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] filter_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance_api_insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance_api_servers = ['http://192.168.122.78/image'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance_api_ssl_compression = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance_ca_certificates_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance_catalog_info = image:glance:publicURL {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance_certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance_keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance_num_retries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance_request_timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] goodness_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] graceful_shutdown_timeout = 5 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] group_api_class = cinder.group.api.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] host = devstack {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] image_compress_on_upload = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] image_conversion_address_space_limit = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] image_conversion_cpu_limit = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] image_conversion_disable = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] image_upload_use_cinder_backend = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] image_upload_use_internal_tenant = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] image_volume_cache_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] image_volume_cache_max_count = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] image_volume_cache_max_size_gb = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] init_host_max_objects_retrieval = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] instance_format = [instance: %(uuid)s] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] iscsi_target_flags = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] iscsi_write_cache = on {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] iser_helper = tgtadm {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] iser_ip_address = 192.168.122.78 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] iser_port = 3260 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] log_color = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] log_config_append = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] log_dir = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] log_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] log_options = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] log_rotate_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] log_rotate_interval_type = days {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] log_rotation_type = none {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] max_age = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] max_logfile_count = 30 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] max_logfile_size_mb = 200 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] max_over_subscription_ratio = 20.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] message_reap_interval = 86400 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] message_ttl = 2592000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] migration_create_volume_timeout_secs = 300 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] monkey_patch = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] monkey_patch_modules = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] my_ip = 192.168.122.78 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] no_snapshot_gb_quota = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] num_iser_scan_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] num_shell_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] num_volume_device_scan_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] nvmeof_conn_info_version = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82739]: INFO cinder.volume.manager [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Starting volume driver QuobyteDriver (1.1.14) Feb 26 03:00:40 devstack cinder-volume[82739]: DEBUG cinder.volume.drivers.remotefs [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82739) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] nvmet_ns_id = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] nvmet_port_id = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] osapi_max_limit = 1000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] osapi_volume_ext_list = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] osapi_volume_listen_port = 8776 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] osapi_volume_use_ssl = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] osapi_volume_workers = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] per_volume_size_limit = -1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] periodic_fuzzy_delay = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] periodic_interval = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] public_endpoint = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] publish_errors = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] quota_backup_gigabytes = 1000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] quota_backups = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] quota_gigabytes = 1000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] quota_groups = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] quota_snapshots = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] quota_volumes = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] rate_limit_burst = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] rate_limit_except_level = CRITICAL {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] rate_limit_interval = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] reinit_driver_count = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] replication_device = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] report_discard_supported = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] report_interval = 120 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] reservation_clean_interval = 86400 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] reservation_expire = 86400 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] reserved_image_namespaces = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] reserved_percentage = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] rpc_response_timeout = 120 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] run_external_periodic_tasks = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] scst_target_driver = iscsi {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] scst_target_iqn_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_down_time = 720 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] shell_completion = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] snapshot_name_template = snapshot-%s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] split_loggers = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] state_path = /opt/stack/data/cinder {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] storage_availability_zone = nova {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] storage_protocol = iSCSI {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] syslog_log_facility = LOG_USER {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] target_helper = lioadm {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] target_ip_address = 192.168.122.78 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] target_port = 3260 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] target_protocol = iscsi {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] target_secondary_ip_addresses = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] trace_flags = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] transport_url = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] until_refresh = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] use_chap_auth = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] use_default_quota_class = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] use_journal = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] use_json = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] use_multipath_for_image_xfer = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] use_stderr = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] use_syslog = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] verify_glance_signatures = enabled {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_api_class = cinder.volume.api.API {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_backend_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_clear = zero {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_clear_ionice = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_clear_size = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_copy_bps_limit = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_dd_blocksize = 1M {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_name_template = volume-%s {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_service_inithost_offload = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volume_usage_audit_period = month {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] zoning_mode = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_concurrency.disable_process_locking = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.admin_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.admin_token = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.admin_user = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.auth_port = 35357 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.auth_protocol = https {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.auth_section = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.auth_type = password {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.auth_uri = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.auth_version = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.cache = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.identity_uri = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.include_service_catalog = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.interface = public {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_password = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcache_username = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.region_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.service_type = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.78/identity {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.backend = dogpile.cache.null {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.backend_argument = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.backend_expiration_time = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.config_prefix = cache.oslo {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.debug_cache_backend = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.enable_retry_client = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.enable_socket_keepalive = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.enforce_fips_mode = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.expiration_time = 600 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.hashclient_retry_attempts = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.memcache_dead_retry = 300 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.memcache_pool_maxsize = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.memcache_sasl_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.proxies = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.redis_db = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.redis_server = localhost:6379 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.retry_attempts = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.retry_delay = 0.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.socket_keepalive_count = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.socket_keepalive_idle = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.socket_keepalive_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.socket_timeout = 1.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.tls_allowed_ciphers = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.tls_cafile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.tls_certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.tls_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.tls_keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cache.username = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] coordination.backend_url = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.asyncio_connection = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.asyncio_slave_connection = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.backend = sqlalchemy {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.connection = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.connection_debug = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.connection_parameters = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.connection_recycle_time = 3600 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.connection_trace = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.db_inc_retry_interval = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.db_max_retries = 20 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.db_max_retry_interval = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.db_retry_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.max_overflow = 50 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.max_pool_size = 5 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.max_retries = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.mysql_wsrep_sync_wait = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.pool_timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.retry_interval = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.slave_connection = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.sqlite_synchronous = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.synchronous_reader = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] database.use_db_reconnect = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.connection_string = messaging:// {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.es_doc_type = notification {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.es_scroll_size = 10000 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.es_scroll_time = 2m {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.filter_error_trace = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.hmac_keys = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.sentinel_service_name = mymaster {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.socket_timeout = 0.1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.trace_requests = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler.trace_sqlalchemy = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler_jaeger.process_tags = {} {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler_jaeger.service_name_prefix = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] profiler_otlp.service_name_prefix = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.enforce_new_defaults = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82739]: DEBUG cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82739) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 26 03:00:40 devstack cinder-volume[82739]: WARNING cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 26 03:00:40 devstack cinder-volume[82739]: WARNING cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 26 03:00:40 devstack cinder-volume[82624]: WARNING oslo_config.cfg [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.enforce_scope = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.policy_default_rule = default {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.policy_file = policy.yaml {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] privsep_osbrick.group = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] privsep_osbrick.helper_command = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] privsep_osbrick.user = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cinder_sys_admin.group = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cinder_sys_admin.helper_command = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] cinder_sys_admin.user = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_user.auth_section = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_user.auth_type = password {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_user.cafile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_user.certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_user.collect_timing = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_user.insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_user.keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_user.send_service_user_token = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_user.split_loggers = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] service_user.timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance.auth_section = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance.auth_type = password {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance.certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance.collect_timing = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance.insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance.keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance.region_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance.split_loggers = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] glance.timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.backend_availability_zone = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.chap_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.chap_username = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.disk_geometry = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.driver_client_cert = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.driver_client_cert_key = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.driver_data_namespace = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.driver_use_ssl = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.extra_capabilities = {} {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.filter_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.goodness_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.iscsi_target_flags = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.iscsi_write_cache = on {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.iser_helper = tgtadm {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Running cmd (subprocess): mount.quobyte {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.iser_ip_address = 192.168.122.78 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.iser_port = 3260 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nas_host = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nas_login = admin {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nas_mount_options = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nas_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nas_private_key = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nas_share_path = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.num_shell_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.quobyte_volume_url = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.replication_device = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.report_discard_supported = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.reserved_percentage = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.target_helper = tgtadm {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.target_ip_address = 192.168.122.78 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.target_port = 3260 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.target_protocol = iscsi {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.trace_flags = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.unique_fqdn_network = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.use_chap_auth = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.volume_backend_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.volume_clear = zero {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.volume_clear_ionice = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.volume_clear_size = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_reports.file_event_handler = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_reports.log_dir = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.backend_availability_zone = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.backend_host = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.chap_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.chap_username = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.chiscsi_conf = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.disk_geometry = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.driver_client_cert = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.driver_data_namespace = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.driver_use_ssl = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.extra_capabilities = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.filter_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.goodness_function = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.iser_helper = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.iser_ip_address = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.iser_port = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.iser_target_prefix = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nas_host = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nas_login = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nas_mount_options = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nas_password = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nas_private_key = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nas_share_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nas_ssh_port = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.num_shell_tries = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.nvmet_port_id = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.replication_device = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.report_discard_supported = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.reserved_percentage = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.scst_target_driver = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.storage_protocol = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.target_helper = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.target_ip_address = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.target_port = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.target_prefix = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.target_protocol = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.trace_flags = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.use_chap_auth = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.volume_clear = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.volume_clear_size = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] QuobyteHD.volumes_dir = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.ssl = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_notifications.driver = [] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_notifications.retry = -1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] key_manager.fixed_key = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.barbican_api_version = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.barbican_endpoint = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.barbican_endpoint_type = public {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.barbican_region_name = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.cafile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.collect_timing = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.number_of_retries = 60 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.retry_delay = 1 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.send_service_user_token = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.split_loggers = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.verify_ssl = True {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican.verify_ssl_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican_service_user.auth_section = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican_service_user.auth_type = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican_service_user.cafile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican_service_user.certfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican_service_user.collect_timing = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican_service_user.insecure = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican_service_user.keyfile = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican_service_user.split_loggers = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] barbican_service_user.timeout = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.approle_role_id = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.approle_secret_id = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.kv_mountpoint = secret {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.kv_path = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.kv_version = 2 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.namespace = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.root_token_id = **** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.ssl_ca_crt_file = None {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.timeout = 60.0 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.use_ssl = False {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:40 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] ******************************************************************************** {{(pid=82624) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 26 03:00:40 devstack quobyte-client[82743]: Reading configuration file: /etc/quobyte/client.cfg Feb 26 03:00:40 devstack quobyte-client[82743]: Invalid parameters found, error: missing mount point. Feb 26 03:00:40 devstack quobyte-client[82743]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 26 03:00:40 devstack quobyte-client[82743]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 26 03:00:40 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] CMD "mount.quobyte" returned: 1 in 0.121s {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:40 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:00:40 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:00:40 devstack cinder-volume[82739]: DEBUG cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=82739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:00:40 devstack cinder-volume[82739]: INFO cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d ... Feb 26 03:00:40 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d -c /etc/quobyte/client-cinder.cfg {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:40 devstack sudo[82744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d -c /etc/quobyte/client-cinder.cfg Feb 26 03:00:40 devstack sudo[82744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:41 devstack sudo[82744]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.481s {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:41 devstack cinder-volume[82739]: INFO cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d succeeded Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=82739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.487s {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:41 devstack sudo[82814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:00:41 devstack sudo[82814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:41 devstack sudo[82814]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.364s {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:41 devstack cinder-volume[82739]: INFO cinder.volume.driver [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Driver hasn't implemented _init_vendor_properties() Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.volume.driver [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580528259277, 'free_capacity_gb': 1775.7580528259277, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82739) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_db.sqlalchemy.engines [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82739) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG dbcounter [-] [82739] Writer thread running {{(pid=82739) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.db.sqlalchemy.api [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Building query based on filter {{(pid=82739) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.image.image_utils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82739) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 26 03:00:41 devstack cinder-volume[82739]: INFO cinder.keymgr.migration [None req-0dfa0a09-3337-4613-9834-2b8210977109 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=82739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=82739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:41 devstack sudo[82817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:00:41 devstack sudo[82817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:41 devstack sudo[82817]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.366s {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.manager [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Notifying Schedulers of capabilities ... {{(pid=82739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:00:41 devstack cinder-volume[82739]: INFO cinder.volume.manager [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Driver initialization completed successfully. Feb 26 03:00:41 devstack cinder-volume[82739]: INFO cinder.manager [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Initiating service 3 cleanup Feb 26 03:00:41 devstack cinder-volume[82739]: INFO cinder.manager [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Service 3 cleanup completed. Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.service [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Creating RPC server for service cinder-volume {{(pid=82739) start /opt/stack/cinder/cinder/service.py:231}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.service [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82739) start /opt/stack/cinder/cinder/service.py:237}} Feb 26 03:00:41 devstack cinder-volume[82739]: INFO cinder.volume.manager [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=82739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG cinder.volume.drivers.quobyte [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=82739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:00:41 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:42 devstack sudo[82821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:00:42 devstack sudo[82821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:42 devstack sudo[82821]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:42 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.377s {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:42 devstack cinder-volume[82739]: INFO cinder.volume.manager [None req-2903746f-6fd8-409f-afae-a510cb21c8bb None None] Driver post RPC initialization completed successfully. Feb 26 03:00:45 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-86b30877-970d-4c44-82ae-00a074d6669a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:00:45 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-86b30877-970d-4c44-82ae-00a074d6669a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:00:45 devstack cinder-volume[82739]: DEBUG cinder.volume.drivers.quobyte [None req-86b30877-970d-4c44-82ae-00a074d6669a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=82739) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:00:45 devstack cinder-volume[82739]: DEBUG cinder.volume.drivers.quobyte [None req-86b30877-970d-4c44-82ae-00a074d6669a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=82739) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:00:45 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-86b30877-970d-4c44-82ae-00a074d6669a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:00:45 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-86b30877-970d-4c44-82ae-00a074d6669a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:45 devstack sudo[82887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:00:45 devstack sudo[82887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:45 devstack sudo[82887]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:45 devstack cinder-volume[82739]: DEBUG oslo_concurrency.processutils [None req-86b30877-970d-4c44-82ae-00a074d6669a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.382s {{(pid=82739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:45 devstack cinder-volume[82739]: DEBUG cinder.manager [None req-86b30877-970d-4c44-82ae-00a074d6669a None None] Notifying Schedulers of capabilities ... {{(pid=82739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:00:48 devstack cinder-volume[82624]: INFO oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Caught SIGTERM, stopping children Feb 26 03:00:48 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Acquiring lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 03:00:48 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Acquired lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 03:00:48 devstack cinder-volume[82624]: DEBUG oslo_concurrency.lockutils [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Releasing lock "singleton_lock" {{(pid=82624) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 03:00:48 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Stop services. {{(pid=82624) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 26 03:00:48 devstack cinder-volume[82624]: DEBUG oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Killing children. {{(pid=82624) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 26 03:00:48 devstack cinder-volume[82624]: INFO oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Waiting on 1 children to exit Feb 26 03:00:50 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Acquiring lock "singleton_lock" {{(pid=82739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 03:00:50 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Acquired lock "singleton_lock" {{(pid=82739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 03:00:50 devstack cinder-volume[82739]: DEBUG oslo_concurrency.lockutils [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Releasing lock "singleton_lock" {{(pid=82739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 03:00:50 devstack cinder-volume[82739]: WARNING amqp [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 26 03:00:50 devstack cinder-volume[82739]: WARNING amqp [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 26 03:00:50 devstack cinder-volume[82624]: INFO oslo_service.backend._eventlet.service [None req-48fcef10-1bd1-4eae-8795-d14829b514d6 None None] Child 82739 exited with status 0 Feb 26 03:00:52 devstack cinder-volume[82963]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 03:00:52 devstack cinder-volume[82963]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 03:00:52 devstack cinder-volume[82963]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82963) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 03:00:52 devstack cinder-volume[82963]: INFO dbcounter [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Registered counter for database cinder Feb 26 03:00:52 devstack cinder-volume[82963]: DEBUG oslo_db.sqlalchemy.engines [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG dbcounter [-] [82963] Writer thread running {{(pid=82963) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 03:00:53 devstack cinder-volume[82963]: INFO cinder.rpc [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 26 03:00:53 devstack cinder-volume[82963]: INFO cinder.rpc [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_db.sqlalchemy.engines [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 03:00:53 devstack cinder-volume[82963]: INFO cinder.volume.manager [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Determined volume DB was empty at startup. Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG cinder.volume.manager [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82963) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 26 03:00:53 devstack cinder-volume[82963]: WARNING stevedore.named [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 26 03:00:53 devstack cinder-volume[82963]: WARNING castellan.key_manager [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 03:00:53 devstack cinder-volume[82963]: WARNING cinder.keymgr.conf_key_mgr [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 03:00:53 devstack cinder-volume[82963]: INFO cinder.volume.manager [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_db.sqlalchemy.engines [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 03:00:53 devstack cinder-volume[82963]: INFO oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Starting 1 workers Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Started child 83121 {{(pid=82963) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Full set of CONF: {{(pid=82963) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] ******************************************************************************** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Configuration options gathered from: {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 26 03:00:53 devstack cinder-volume[83121]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] ================================================================================ {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] allow_availability_zone_fallback = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] allow_compression_on_image_upload = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] allowed_direct_url_schemes = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] api_rate_limit = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] auth_strategy = keystone {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_availability_zone = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_host = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_stats_polling_interval = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backup_api_class = cinder.backup.api.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backup_name_template = backup-%s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backup_use_same_host = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backup_use_temp_snapshot = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] chap_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] chap_username = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cinder_internal_tenant_project_id = d7f84376aac4432ab7004abc417888f9 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cinder_internal_tenant_user_id = c54cb05084844480920a4a16d77cac35 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cluster = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] compression_format = gzip {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] compute_api_class = cinder.compute.nova.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] config_dir = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] config_source = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] control_exchange = openstack {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] debug = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] default_availability_zone = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] default_group_type = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] default_volume_type = QuobyteHD {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] disk_geometry = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] driver_client_cert = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] driver_client_cert_key = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] driver_data_namespace = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] driver_ssl_cert_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] driver_ssl_cert_verify = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] driver_use_ssl = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] enable_new_services = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] enable_unsupported_driver = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] enabled_backends = ['QuobyteHD'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] enforce_multipath_for_image_xfer = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] filter_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance_api_insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance_api_servers = ['http://192.168.122.78/image'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance_api_ssl_compression = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance_ca_certificates_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance_catalog_info = image:glance:publicURL {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 26 03:00:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83121) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance_certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance_keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance_num_retries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance_request_timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] goodness_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] graceful_shutdown_timeout = 5 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] group_api_class = cinder.group.api.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] host = devstack {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] image_compress_on_upload = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] image_conversion_address_space_limit = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] image_conversion_cpu_limit = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] image_conversion_disable = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] image_upload_use_cinder_backend = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] image_upload_use_internal_tenant = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] image_volume_cache_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] image_volume_cache_max_count = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] image_volume_cache_max_size_gb = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] init_host_max_objects_retrieval = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] instance_format = [instance: %(uuid)s] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] iscsi_target_flags = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] iscsi_write_cache = on {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] iser_helper = tgtadm {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] iser_ip_address = 192.168.122.78 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] iser_port = 3260 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] log_color = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] log_config_append = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] log_dir = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] log_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] log_options = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] log_rotate_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] log_rotate_interval_type = days {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] log_rotation_type = none {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] max_age = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] max_logfile_count = 30 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] max_logfile_size_mb = 200 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] max_over_subscription_ratio = 20.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] message_reap_interval = 86400 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] message_ttl = 2592000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] migration_create_volume_timeout_secs = 300 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] monkey_patch = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] monkey_patch_modules = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] my_ip = 192.168.122.78 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] no_snapshot_gb_quota = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] num_iser_scan_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] num_shell_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] num_volume_device_scan_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] nvmeof_conn_info_version = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] nvmet_ns_id = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] nvmet_port_id = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] osapi_max_limit = 1000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] osapi_volume_ext_list = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] osapi_volume_listen = 0.0.0.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] osapi_volume_listen_port = 8776 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] osapi_volume_use_ssl = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] osapi_volume_workers = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] per_volume_size_limit = -1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] periodic_fuzzy_delay = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] periodic_interval = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] project_id_regex = [0-9a-f\-]+ {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] public_endpoint = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] publish_errors = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] quota_backup_gigabytes = 1000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] quota_backups = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] quota_gigabytes = 1000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] quota_groups = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] quota_snapshots = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] quota_volumes = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] rate_limit_burst = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] rate_limit_except_level = CRITICAL {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] rate_limit_interval = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] reinit_driver_count = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] replication_device = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] report_discard_supported = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] report_interval = 120 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] reservation_clean_interval = 86400 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] reservation_expire = 86400 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] reserved_image_namespaces = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] reserved_percentage = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] rpc_response_timeout = 120 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] run_external_periodic_tasks = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] scst_target_driver = iscsi {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] scst_target_iqn_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_down_time = 720 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] shell_completion = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] snapshot_name_template = snapshot-%s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] split_loggers = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] state_path = /opt/stack/data/cinder {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] storage_availability_zone = nova {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] storage_protocol = iSCSI {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] syslog_log_facility = LOG_USER {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] target_helper = lioadm {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] target_ip_address = 192.168.122.78 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] target_port = 3260 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] target_protocol = iscsi {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] target_secondary_ip_addresses = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] trace_flags = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] transfer_api_class = cinder.transfer.api.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] transport_url = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] until_refresh = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] use_chap_auth = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] use_default_quota_class = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] use_journal = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] use_json = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] use_multipath_for_image_xfer = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] use_stderr = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] use_syslog = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] verify_glance_signatures = enabled {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_api_class = cinder.volume.api.API {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_backend_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_clear = zero {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_clear_ionice = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_clear_size = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_copy_bps_limit = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_dd_blocksize = 1M {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_name_template = volume-%s {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_service_inithost_offload = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volume_usage_audit_period = month {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] zoning_mode = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_concurrency.disable_process_locking = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.admin_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.admin_token = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.admin_user = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.auth_admin_prefix = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.auth_port = 35357 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.auth_protocol = https {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.auth_section = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.auth_type = password {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.auth_uri = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.auth_version = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.cache = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.delay_auth_decision = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.http_connect_timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83121) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.identity_uri = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.quobyte [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 26 03:00:53 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.quobyte [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.include_service_catalog = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Running cmd (subprocess): mount.quobyte {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.interface = public {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_password = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcache_username = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.region_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.service_token_roles_required = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.service_type = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.token_cache_time = 300 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.78/identity {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.backend = dogpile.cache.null {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.backend_argument = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.backend_expiration_time = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.config_prefix = cache.oslo {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.debug_cache_backend = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.enable_retry_client = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.enable_socket_keepalive = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.enforce_fips_mode = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.expiration_time = 600 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.hashclient_retry_attempts = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.memcache_dead_retry = 300 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.memcache_pool_maxsize = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.memcache_sasl_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.proxies = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.redis_db = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.redis_sentinel_service_name = mymaster {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.redis_server = localhost:6379 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.retry_attempts = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.retry_delay = 0.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.socket_keepalive_count = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.socket_keepalive_idle = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.socket_keepalive_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.socket_timeout = 1.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.tls_allowed_ciphers = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.tls_cafile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.tls_certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.tls_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.tls_keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cache.username = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] coordination.backend_url = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.asyncio_connection = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.asyncio_slave_connection = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.backend = sqlalchemy {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.connection = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.connection_debug = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.connection_parameters = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.connection_recycle_time = 3600 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.connection_trace = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.db_inc_retry_interval = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.db_max_retries = 20 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.db_max_retry_interval = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.db_retry_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.max_overflow = 50 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.max_pool_size = 5 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.max_retries = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.mysql_wsrep_sync_wait = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.pool_timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.retry_interval = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.slave_connection = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.sqlite_synchronous = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.synchronous_reader = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] database.use_db_reconnect = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.connection_string = messaging:// {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.es_doc_type = notification {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.es_scroll_size = 10000 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.es_scroll_time = 2m {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.filter_error_trace = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.hmac_keys = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.sentinel_service_name = mymaster {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.socket_timeout = 0.1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.trace_requests = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler.trace_sqlalchemy = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler_jaeger.process_tags = {} {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler_jaeger.service_name_prefix = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] profiler_otlp.service_name_prefix = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.enforce_new_defaults = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: WARNING oslo_config.cfg [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.enforce_scope = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.policy_default_rule = default {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.policy_file = policy.yaml {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_policy.remote_timeout = 60.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] privsep_osbrick.group = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] privsep_osbrick.helper_command = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] privsep_osbrick.user = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cinder_sys_admin.group = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cinder_sys_admin.helper_command = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] cinder_sys_admin.user = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_user.auth_section = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_user.auth_type = password {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_user.cafile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_user.certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_user.collect_timing = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_user.insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_user.keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_user.send_service_user_token = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_user.split_loggers = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] service_user.timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance.auth_section = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance.auth_type = password {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance.certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance.collect_timing = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance.insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance.keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance.region_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance.split_loggers = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] glance.timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.backend_availability_zone = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.chap_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.chap_username = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack quobyte-client[83156]: Reading configuration file: /etc/quobyte/client.cfg Feb 26 03:00:53 devstack quobyte-client[83156]: Invalid parameters found, error: missing mount point. Feb 26 03:00:53 devstack quobyte-client[83156]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 26 03:00:53 devstack quobyte-client[83156]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.disk_geometry = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.driver_client_cert = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.driver_client_cert_key = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.driver_data_namespace = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.driver_use_ssl = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.enable_unsupported_driver = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.extra_capabilities = {} {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.filter_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.goodness_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.iscsi_target_flags = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.iscsi_write_cache = on {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.iser_helper = tgtadm {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.iser_ip_address = 192.168.122.78 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.iser_port = 3260 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nas_host = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nas_login = admin {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nas_mount_options = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nas_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nas_private_key = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] CMD "mount.quobyte" returned: 1 in 0.115s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nas_share_path = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nas_ssh_port = 22 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:00:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.num_shell_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.nvmet_port_id = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.quobyte_client_cfg = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.quobyte_volume_url = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.replication_device = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.report_discard_supported = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.reserved_percentage = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.scst_target_driver = iscsi {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.scst_target_iqn_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.storage_protocol = iSCSI {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.target_helper = tgtadm {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.target_ip_address = 192.168.122.78 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.target_port = 3260 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.target_protocol = iscsi {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.trace_flags = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.unique_fqdn_network = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.use_chap_auth = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.volume_backend_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.volume_clear = zero {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.volume_clear_ionice = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.volume_clear_size = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_reports.file_event_handler = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_reports.log_dir = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.backend_availability_zone = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.backend_host = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.chap_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.chap_username = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.chiscsi_conf = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.disk_geometry = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.driver_client_cert = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.driver_client_cert_key = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.driver_data_namespace = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.driver_use_ssl = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.extra_capabilities = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.filter_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.goodness_function = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.iscsi_target_flags = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.iscsi_write_cache = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.iser_helper = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.iser_ip_address = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.iser_port = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.iser_target_prefix = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nas_host = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nas_login = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nas_mount_options = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nas_password = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nas_private_key = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nas_share_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack sudo[83168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nas_ssh_port = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.num_shell_tries = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nvmet_ns_id = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack sudo[83168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.nvmet_port_id = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.replication_device = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.report_discard_supported = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.reserved_percentage = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.scst_target_driver = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.storage_protocol = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.target_helper = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.target_ip_address = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.target_port = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.target_prefix = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.target_protocol = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.trace_flags = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.unique_fqdn_network = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.use_chap_auth = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.volume_clear = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.volume_clear_ionice = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.volume_clear_size = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] QuobyteHD.volumes_dir = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.ssl = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.ssl_version = {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_notifications.driver = [] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_notifications.retry = -1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] oslo_messaging_notifications.transport_url = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] key_manager.fixed_key = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.barbican_api_version = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.barbican_endpoint = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.barbican_endpoint_type = public {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.barbican_region_name = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.cafile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.collect_timing = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.number_of_retries = 60 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.retry_delay = 1 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.send_service_user_token = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.split_loggers = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.verify_ssl = True {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican.verify_ssl_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican_service_user.auth_section = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican_service_user.auth_type = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican_service_user.cafile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican_service_user.certfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican_service_user.collect_timing = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican_service_user.insecure = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican_service_user.keyfile = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican_service_user.split_loggers = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] barbican_service_user.timeout = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.approle_role_id = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.approle_secret_id = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.kv_mountpoint = secret {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.kv_path = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.kv_version = 2 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.namespace = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.root_token_id = **** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.ssl_ca_crt_file = None {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.timeout = 60.0 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.use_ssl = False {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 03:00:53 devstack cinder-volume[82963]: DEBUG oslo_service.backend._eventlet.service [None req-0881e2eb-b495-4265-9bf9-138fd44f930f None None] ******************************************************************************** {{(pid=82963) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 26 03:00:54 devstack sudo[83168]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.419s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:54 devstack cinder-volume[83121]: INFO cinder.volume.driver [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Driver hasn't implemented _init_vendor_properties() Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG cinder.volume.driver [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580528259277, 'free_capacity_gb': 1775.7580528259277, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83121) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_db.sqlalchemy.engines [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83121) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writer thread running {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG cinder.db.sqlalchemy.api [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Building query based on filter {{(pid=83121) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83121) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:54 devstack cinder-volume[83121]: INFO cinder.keymgr.migration [None req-38f535c7-9bb6-488a-91d7-59e5f6aeb1d5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 26 03:00:54 devstack sudo[83199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:00:54 devstack sudo[83199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:54 devstack sudo[83199]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.412s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:00:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Driver initialization completed successfully. Feb 26 03:00:54 devstack cinder-volume[83121]: INFO cinder.manager [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Initiating service 3 cleanup Feb 26 03:00:54 devstack cinder-volume[83121]: INFO cinder.manager [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Service 3 cleanup completed. Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG cinder.service [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Creating RPC server for service cinder-volume {{(pid=83121) start /opt/stack/cinder/cinder/service.py:231}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG cinder.service [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83121) start /opt/stack/cinder/cinder/service.py:237}} Feb 26 03:00:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:00:54 devstack sudo[83214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:00:54 devstack sudo[83214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:00:54 devstack sudo[83214]: pam_unix(sudo:session): session closed for user root Feb 26 03:00:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.379s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:00:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5795a6d4-0aa4-41e6-b975-19b63a149582 None None] Driver post RPC initialization completed successfully. Feb 26 03:01:03 devstack cinder-volume[82963]: DEBUG dbcounter [-] [82963] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82963) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:01:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:01:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=3 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Flow 'volume_create_manager' (72c5074e-3b1c-4a3c-9588-170e2b4d4bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84770ab1-58ec-4dd7-b6e2-13532c76d492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84770ab1-58ec-4dd7-b6e2-13532c76d492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-50421196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a94dfa-5a89-44f9-b555-9cc17c53357e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7e3b09a1d74c518ca72e9097f56202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:01:54Z,use_quota=True,user_id='5fafa19a582948cfa3d31223ead9c0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9487fd1-f8a1-4071-b55d-cda48f56155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9487fd1-f8a1-4071-b55d-cda48f56155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63df8a2a-c4dc-47d9-a41f-ef923cfb32ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63df8a2a-c4dc-47d9-a41f-ef923cfb32ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a94dfa-5a89-44f9-b555-9cc17c53357e', 'volume_name': 'volume-34a94dfa-5a89-44f9-b555-9cc17c53357e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c71f77-4fee-4c2a-97bd-5b3b6173bce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c71f77-4fee-4c2a-97bd-5b3b6173bce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da55e508-464f-4098-9f41-9da07a461599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:01:54 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Volume 34a94dfa-5a89-44f9-b555-9cc17c53357e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a94dfa-5a89-44f9-b555-9cc17c53357e', 'volume_size': 1} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-50421196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a94dfa-5a89-44f9-b555-9cc17c53357e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7e3b09a1d74c518ca72e9097f56202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:01:54Z,use_quota=True,user_id='5fafa19a582948cfa3d31223ead9c0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Creating volume 34a94dfa-5a89-44f9-b555-9cc17c53357e {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:01:54 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:01:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:01:54 devstack sudo[83495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e 1073741824 Feb 26 03:01:54 devstack sudo[83495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:01:55 devstack sudo[83495]: pam_unix(sudo:session): session closed for user root Feb 26 03:01:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e 1073741824" returned: 0 in 0.655s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:01:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:01:55 devstack sudo[83817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e Feb 26 03:01:55 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:01:55 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root Feb 26 03:01:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e" returned: 0 in 0.486s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:01:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:01:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:01:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da55e508-464f-4098-9f41-9da07a461599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a94dfa-5a89-44f9-b555-9cc17c53357e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:01:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8957a09-6768-4b8c-b4a9-86f0a244c85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:01:55 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Volume volume-34a94dfa-5a89-44f9-b555-9cc17c53357e (34a94dfa-5a89-44f9-b555-9cc17c53357e): created successfully Feb 26 03:01:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8957a09-6768-4b8c-b4a9-86f0a244c85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:01:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Flow 'volume_create_manager' (72c5074e-3b1c-4a3c-9588-170e2b4d4bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:01:55 devstack cinder-volume[83121]: INFO cinder.volume.manager [req-a005854d-f6c1-4a1a-a55d-028e29fb9c8b req-4f13823f-b98a-43b0-ae34-635bcc3e8861 tempest-VolumesSnapshotsTestJSON-38546975 None] Created volume successfully. Feb 26 03:01:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:01:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:01:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Creating offline snapshot afc64198-6add-4298-877b-19639043e32a of volume 34a94dfa-5a89-44f9-b555-9cc17c53357e {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:01:57 devstack cinder-volume[83121]: INFO oslo.privsep.daemon [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp30g4q1z7/privsep.sock'] Feb 26 03:01:57 devstack sudo[83824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp30g4q1z7/privsep.sock Feb 26 03:01:57 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:01:58 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root Feb 26 03:01:58 devstack cinder-volume[83121]: INFO oslo.privsep.daemon [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Spawned new privsep daemon via rootwrap Feb 26 03:01:58 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Accepted privsep connection to /tmp/tmp30g4q1z7/privsep.sock {{(pid=83121) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 26 03:01:58 devstack cinder-volume[83121]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 26 03:01:58 devstack cinder-volume[83121]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 26 03:01:58 devstack cinder-volume[83121]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 26 03:01:58 devstack cinder-volume[83121]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83827 Feb 26 03:01:58 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[50410c88-dbd1-41b1-86f1-066e38a69b8c]: (2,) {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:01:58 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[101e0a79-b860-4e93-92af-327e9bba5b0a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:01:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:01:58 devstack sudo[83829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e Feb 26 03:01:58 devstack sudo[83829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:01:58 devstack sudo[83829]: pam_unix(sudo:session): session closed for user root Feb 26 03:01:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e" returned: 0 in 0.479s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:01:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:01:58 devstack sudo[83834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a 1G Feb 26 03:01:58 devstack sudo[83834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:01:59 devstack sudo[83834]: pam_unix(sudo:session): session closed for user root Feb 26 03:01:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a 1G" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:01:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34a94dfa-5a89-44f9-b555-9cc17c53357e -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:01:59 devstack sudo[83839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34a94dfa-5a89-44f9-b555-9cc17c53357e -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a Feb 26 03:01:59 devstack sudo[83839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:01:59 devstack sudo[83839]: pam_unix(sudo:session): session closed for user root Feb 26 03:01:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34a94dfa-5a89-44f9-b555-9cc17c53357e -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a" returned: 0 in 0.511s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:01:59 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a is being set with open permissions: ugo+rw Feb 26 03:01:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:01:59 devstack sudo[83844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a Feb 26 03:01:59 devstack sudo[83844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:00 devstack sudo[83844]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:00 devstack sudo[83848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.info Feb 26 03:02:00 devstack sudo[83848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:00 devstack sudo[83848]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.info" returned: 0 in 0.502s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:00 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.info is being set with open permissions: ugo+rw Feb 26 03:02:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:00 devstack sudo[83852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.info Feb 26 03:02:00 devstack sudo[83852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:00 devstack sudo[83852]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.info" returned: 0 in 0.407s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.876s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:01 devstack cinder-volume[83121]: INFO cinder.volume.manager [req-cad6bb5f-a312-4606-93ff-bd50e3b5b8c2 req-b2449ac8-690b-49b3-ade8-b4f61836fd33 tempest-VolumesSnapshotsTestJSON-38546975 None] Create snapshot completed successfully Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Acquiring lock "cinder-afc64198-6add-4298-877b-19639043e32a-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "cinder-afc64198-6add-4298-877b-19639043e32a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Acquiring lock "cinder-quobyte-34a94dfa-5a89-44f9-b555-9cc17c53357e" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "cinder-quobyte-34a94dfa-5a89-44f9-b555-9cc17c53357e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Acquiring lock "cinder-quobyte-afc64198-6add-4298-877b-19639043e32a" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "cinder-quobyte-afc64198-6add-4298-877b-19639043e32a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Deleting offline snapshot afc64198-6add-4298-877b-19639043e32a of volume 34a94dfa-5a89-44f9-b555-9cc17c53357e {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] snapshot_file for this snap is: volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[febd26e9-eba6-4401-930a-8fd0d52e73d8]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:01 devstack sudo[83872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a Feb 26 03:02:01 devstack sudo[83872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:02 devstack sudo[83872]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a" returned: 0 in 0.512s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:02 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34a94dfa-5a89-44f9-b555-9cc17c53357e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:02 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4443a6-178f-4b6c-b7b1-4f554368c7f6]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:02 devstack sudo[83877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e Feb 26 03:02:02 devstack sudo[83877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:02 devstack sudo[83877]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e" returned: 0 in 0.542s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:02 devstack sudo[83883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a Feb 26 03:02:02 devstack sudo[83883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:03 devstack sudo[83883]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a" returned: 0 in 0.451s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:03 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a Feb 26 03:02:03 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:03 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e.afc64198-6add-4298-877b-19639043e32a" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "cinder-quobyte-afc64198-6add-4298-877b-19639043e32a" released by "_delete_snapshot" :: held 2.015s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "cinder-quobyte-34a94dfa-5a89-44f9-b555-9cc17c53357e" released by "delete_snapshot" :: held 2.028s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:03 devstack cinder-volume[83121]: WARNING cinder.quota [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:02:03 devstack cinder-volume[83121]: WARNING cinder.quota [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:02:03 devstack cinder-volume[83121]: DEBUG cinder.quota [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Created reservations ['9bbde3b0-fce2-4e17-a2fe-667e0adb65e6', '0fe27322-65e6-4f5e-8887-fdce9d122734', '69e37d65-240a-47bc-91a2-47786af3b1f0', '9547cb5f-c355-431f-bcd6-e95f90601d1e'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:02:03 devstack cinder-volume[83121]: INFO cinder.volume.manager [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Delete snapshot completed successfully. Feb 26 03:02:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-39c1dc6f-d938-4434-9c57-9e108bc3f290 req-49a54a22-8f97-466f-9845-41ae67bba80b tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "cinder-afc64198-6add-4298-877b-19639043e32a-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Acquiring lock "cinder-34a94dfa-5a89-44f9-b555-9cc17c53357e-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "cinder-34a94dfa-5a89-44f9-b555-9cc17c53357e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Acquiring lock "cinder-quobyte-34a94dfa-5a89-44f9-b555-9cc17c53357e" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "cinder-quobyte-34a94dfa-5a89-44f9-b555-9cc17c53357e" acquired by "delete_volume" :: waited 0.017s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:04 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aad479-e4dd-439b-a02a-5c9f64c301dd]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:05 devstack sudo[83938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e Feb 26 03:02:05 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:05 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e" returned: 0 in 0.528s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:05 devstack sudo[83955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e Feb 26 03:02:05 devstack sudo[83955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:05 devstack sudo[83955]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-34a94dfa-5a89-44f9-b555-9cc17c53357e" returned: 0 in 0.420s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:05 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "cinder-quobyte-34a94dfa-5a89-44f9-b555-9cc17c53357e" released by "delete_volume" :: held 1.048s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:05 devstack cinder-volume[83121]: WARNING cinder.quota [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:02:05 devstack cinder-volume[83121]: DEBUG cinder.quota [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Created reservations ['f03e36d1-290c-429a-99db-b692c11eaae1', 'f07da65b-f922-4053-bd46-5c7e269881cf', '6d8941af-4fc3-44b3-be91-92d47e0f5862', 'f6c3bf74-e1b2-41ac-bbe9-a63136787f8a'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:02:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:06 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:02:06 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:02:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:06 devstack sudo[83980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:02:06 devstack sudo[83980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:06 devstack sudo[83980]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.386s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:06 devstack cinder-volume[83121]: DEBUG cinder.manager [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:02:06 devstack cinder-volume[83121]: INFO cinder.volume.manager [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Deleted volume successfully. Feb 26 03:02:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-7bc0e7d2-904b-4487-ba5b-0c061ec4fd36 req-a19c96dc-b8e7-49c7-a91a-8f42b1d29207 tempest-VolumesSnapshotsTestJSON-38546975 None] Lock "cinder-34a94dfa-5a89-44f9-b555-9cc17c53357e-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Flow 'volume_create_manager' (174d9245-ed41-450b-a414-7ca80048d9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c550627-9393-48ae-8a72-6d2f00006be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c550627-9393-48ae-8a72-6d2f00006be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-612668941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0701ffef-0589-434d-bae4-6b4d7670f5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daa78a8cb47749f3beaf7f2eda4e3ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:02:13Z,use_quota=True,user_id='ba4a2ff1762b451c8b9d81b2c2d5e14d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6d3554-6035-42d2-96f5-b28a9b99d9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6d3554-6035-42d2-96f5-b28a9b99d9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d7b32b-e0e6-4c3d-bece-581374e091e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d7b32b-e0e6-4c3d-bece-581374e091e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0701ffef-0589-434d-bae4-6b4d7670f5f9', 'volume_name': 'volume-0701ffef-0589-434d-bae4-6b4d7670f5f9', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75e5d8b-f6ea-4524-bbe4-2fd9af5468e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75e5d8b-f6ea-4524-bbe4-2fd9af5468e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16b9c99-43ab-4779-bf87-4592de301b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:13 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Volume 0701ffef-0589-434d-bae4-6b4d7670f5f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0701ffef-0589-434d-bae4-6b4d7670f5f9', 'volume_size': 1} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-612668941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0701ffef-0589-434d-bae4-6b4d7670f5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daa78a8cb47749f3beaf7f2eda4e3ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:02:13Z,use_quota=True,user_id='ba4a2ff1762b451c8b9d81b2c2d5e14d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Creating volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:02:13 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:13 devstack sudo[84016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 1073741824 Feb 26 03:02:13 devstack sudo[84016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:13 devstack sudo[84016]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 1073741824" returned: 0 in 0.452s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:13 devstack sudo[84021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 Feb 26 03:02:13 devstack sudo[84021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:14 devstack sudo[84021]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16b9c99-43ab-4779-bf87-4592de301b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0701ffef-0589-434d-bae4-6b4d7670f5f9', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3486c7da-ce00-4ec7-b512-cbdb062cbd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:14 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Volume volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 (0701ffef-0589-434d-bae4-6b4d7670f5f9): created successfully Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3486c7da-ce00-4ec7-b512-cbdb062cbd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Flow 'volume_create_manager' (174d9245-ed41-450b-a414-7ca80048d9dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:02:14 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9f5041af-d09b-4fd3-a776-21eb7ff5cd62 tempest-SnapshotsActionsTest-2036197938 None] Created volume successfully. Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Creating offline snapshot ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 of volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[44157927-8a43-4bee-b722-7c534b4c1974]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:14 devstack sudo[84024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 Feb 26 03:02:14 devstack sudo[84024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:14 devstack sudo[84024]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9" returned: 0 in 0.453s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:14 devstack sudo[84029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 1G Feb 26 03:02:14 devstack sudo[84029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:15 devstack sudo[84029]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 1G" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:15 devstack sudo[84034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:15 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:15 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.378s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:15 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 is being set with open permissions: ugo+rw Feb 26 03:02:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:15 devstack sudo[84039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:15 devstack sudo[84039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:15 devstack sudo[84039]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.374s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:16 devstack sudo[84042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.info Feb 26 03:02:16 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:16 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.info" returned: 0 in 0.408s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:16 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.info is being set with open permissions: ugo+rw Feb 26 03:02:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:16 devstack sudo[84045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.info Feb 26 03:02:16 devstack sudo[84045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:16 devstack sudo[84045]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.info" returned: 0 in 0.366s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:16 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-204ade3e-fc59-4bf9-9c20-977094d6ab6a tempest-SnapshotsActionsTest-2036197938 None] Create snapshot completed successfully Feb 26 03:02:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] Creating offline snapshot 21e2a5b5-c090-49aa-a168-155ae8af1e11 of volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:02:17 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[730e5c3b-8558-4f00-ada3-7e0d5824885a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:17 devstack sudo[84048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:17 devstack sudo[84048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:18 devstack sudo[84048]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:18 devstack sudo[84053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 1G Feb 26 03:02:18 devstack sudo[84053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:18 devstack sudo[84053]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 1G" returned: 0 in 0.485s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:18 devstack sudo[84058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 Feb 26 03:02:18 devstack sudo[84058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:19 devstack sudo[84058]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11" returned: 0 in 0.385s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:19 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 is being set with open permissions: ugo+rw Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:19 devstack sudo[84063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 Feb 26 03:02:19 devstack sudo[84063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:19 devstack sudo[84063]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11" returned: 0 in 0.401s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:19 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f2e0ecc1-57d3-44cf-9838-cc83b82dfb24 tempest-SnapshotsActionsTest-2036197938 None] Create snapshot completed successfully Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-21e2a5b5-c090-49aa-a168-155ae8af1e11-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-21e2a5b5-c090-49aa-a168-155ae8af1e11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-quobyte-21e2a5b5-c090-49aa-a168-155ae8af1e11" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-21e2a5b5-c090-49aa-a168-155ae8af1e11" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Deleting offline snapshot 21e2a5b5-c090-49aa-a168-155ae8af1e11 of volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] snapshot_file for this snap is: volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b15d434-a94f-4eb5-bc17-62f1e20ddbc6]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:20 devstack sudo[84066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 Feb 26 03:02:20 devstack sudo[84066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:20 devstack sudo[84066]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:20 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa91602-744f-4487-9955-c63b4e00ee21]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:20 devstack sudo[84071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:20 devstack sudo[84071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:20 devstack sudo[84071]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.435s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:20 devstack sudo[84076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 Feb 26 03:02:20 devstack sudo[84076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:21 devstack sudo[84076]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:21 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11 Feb 26 03:02:21 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:21 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.21e2a5b5-c090-49aa-a168-155ae8af1e11" returned: 0 in 0.388s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-21e2a5b5-c090-49aa-a168-155ae8af1e11" released by "_delete_snapshot" :: held 1.755s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" released by "delete_snapshot" :: held 1.766s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:21 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Created reservations ['ba084c11-5f47-4d7e-bfc5-fb457848ed42', '111feb75-97ec-4f6a-9f81-99eafb61b7a3', 'c8fcf36d-8fca-4d49-ba8b-d1e0e4e475e0', '0a5f9358-9e2d-4365-9023-37377e6860d5'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:02:21 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Delete snapshot completed successfully. Feb 26 03:02:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3b355422-3254-4159-8872-f5873040301d tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-21e2a5b5-c090-49aa-a168-155ae8af1e11-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] Creating offline snapshot 067903c7-aaa4-4241-9448-4b7fe595e9e1 of volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:02:22 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a5c9d0-9cd5-4e56-b47e-bbcc27cf22ea]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:22 devstack sudo[84085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:22 devstack sudo[84085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:22 devstack sudo[84085]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.437s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:22 devstack sudo[84090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 1G Feb 26 03:02:22 devstack sudo[84090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:23 devstack sudo[84090]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 1G" returned: 0 in 0.440s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:23 devstack sudo[84095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 Feb 26 03:02:23 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:23 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1" returned: 0 in 0.389s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:23 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 is being set with open permissions: ugo+rw Feb 26 03:02:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:23 devstack sudo[84100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 Feb 26 03:02:23 devstack sudo[84100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:23 devstack sudo[84100]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.704s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:23 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e993957e-a721-4fc3-a317-436118c9e688 tempest-SnapshotsActionsTest-2036197938 None] Create snapshot completed successfully Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-067903c7-aaa4-4241-9448-4b7fe595e9e1-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-067903c7-aaa4-4241-9448-4b7fe595e9e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-quobyte-067903c7-aaa4-4241-9448-4b7fe595e9e1" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-067903c7-aaa4-4241-9448-4b7fe595e9e1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Deleting offline snapshot 067903c7-aaa4-4241-9448-4b7fe595e9e1 of volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] snapshot_file for this snap is: volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90caef4-bc4e-41c2-bed8-c890e5902ee5]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:24 devstack sudo[84103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 Feb 26 03:02:24 devstack sudo[84103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:24 devstack sudo[84103]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1" returned: 0 in 0.429s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a108a14-1449-4910-ac8b-9205622b8af2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:24 devstack sudo[84110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:24 devstack sudo[84110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:25 devstack sudo[84110]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.466s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:25 devstack sudo[84115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 Feb 26 03:02:25 devstack sudo[84115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:25 devstack sudo[84115]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1" returned: 0 in 0.426s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:25 devstack sudo[84120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1 Feb 26 03:02:25 devstack sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:26 devstack sudo[84120]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.067903c7-aaa4-4241-9448-4b7fe595e9e1" returned: 0 in 0.381s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-067903c7-aaa4-4241-9448-4b7fe595e9e1" released by "_delete_snapshot" :: held 1.748s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" released by "delete_snapshot" :: held 1.758s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:26 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Created reservations ['3332553b-8df3-496a-a4bd-9086b2e0b864', '1026d9db-0112-490f-8727-81cacad74705', 'f4fc930e-b9ab-4bd3-8a00-e621fcb88795', 'c6da6580-2e3b-41e6-9a55-f4b2c1b95f18'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:02:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Delete snapshot completed successfully. Feb 26 03:02:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5f97788-d696-4c10-a2d6-520561544359 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-067903c7-aaa4-4241-9448-4b7fe595e9e1-delete_snapshot" released by "delete_snapshot" :: held 1.838s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] Creating offline snapshot 1f3917c6-9bdd-43af-8871-25bb833fcc5f of volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:02:26 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4ac2e1-6947-47f4-917e-f03d42ec8295]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:26 devstack sudo[84123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:26 devstack sudo[84123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:27 devstack sudo[84123]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.431s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:27 devstack sudo[84128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f 1G Feb 26 03:02:27 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:27 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f 1G" returned: 0 in 0.472s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:27 devstack sudo[84133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f Feb 26 03:02:27 devstack sudo[84133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:27 devstack sudo[84133]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f" returned: 0 in 0.391s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:27 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f is being set with open permissions: ugo+rw Feb 26 03:02:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:27 devstack sudo[84138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f Feb 26 03:02:27 devstack sudo[84138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:28 devstack sudo[84138]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f" returned: 0 in 0.363s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.713s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:28 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-c3094a9c-24a0-4e11-83c1-04d8fbd85d98 tempest-SnapshotsActionsTest-2036197938 None] Create snapshot completed successfully Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-1f3917c6-9bdd-43af-8871-25bb833fcc5f-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-1f3917c6-9bdd-43af-8871-25bb833fcc5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-quobyte-1f3917c6-9bdd-43af-8871-25bb833fcc5f" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-1f3917c6-9bdd-43af-8871-25bb833fcc5f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Deleting offline snapshot 1f3917c6-9bdd-43af-8871-25bb833fcc5f of volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] snapshot_file for this snap is: volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[11692b67-cd2b-4530-9c05-58ee55a32872]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:28 devstack sudo[84141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f Feb 26 03:02:28 devstack sudo[84141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:29 devstack sudo[84141]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f" returned: 0 in 0.431s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:29 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be26c91-2173-4a19-a3d2-443f42d12962]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:29 devstack sudo[84146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:29 devstack sudo[84146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:29 devstack sudo[84146]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.453s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:29 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f Feb 26 03:02:29 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:30 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f" returned: 0 in 0.463s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:30 devstack sudo[84156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f Feb 26 03:02:30 devstack sudo[84156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:30 devstack sudo[84156]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.1f3917c6-9bdd-43af-8871-25bb833fcc5f" returned: 0 in 0.367s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-1f3917c6-9bdd-43af-8871-25bb833fcc5f" released by "_delete_snapshot" :: held 1.752s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" released by "delete_snapshot" :: held 1.767s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:30 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Created reservations ['018d8d71-eb30-4434-a7b2-bf805d340542', '92adbe45-7be7-4d1f-9a87-b3deb57fd0ac', '78cdefa9-4263-4a8a-862f-dd29320d17b6', 'f05d9d68-7f5f-4c2e-8e86-a6f4924887ca'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:02:30 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Delete snapshot completed successfully. Feb 26 03:02:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-188a5acb-2e46-4604-837c-a34fe19c6898 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-1f3917c6-9bdd-43af-8871-25bb833fcc5f-delete_snapshot" released by "delete_snapshot" :: held 1.846s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] Creating offline snapshot a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 of volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc9f20-1887-4409-b3c8-f1c4d642f48d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:31 devstack sudo[84160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:31 devstack sudo[84160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:31 devstack sudo[84160]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.436s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:31 devstack sudo[84165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 1G Feb 26 03:02:31 devstack sudo[84165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:31 devstack sudo[84170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:02:31 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:32 devstack sudo[84165]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 1G" returned: 0 in 0.475s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:32 devstack sudo[84172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 Feb 26 03:02:32 devstack sudo[84172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:32 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:02:32 devstack sudo[84172]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9" returned: 0 in 0.425s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:32 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 is being set with open permissions: ugo+rw Feb 26 03:02:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:32 devstack sudo[84178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 Feb 26 03:02:32 devstack sudo[84178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:32 devstack sudo[84178]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9" returned: 0 in 0.369s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.749s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:32 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9611d1b6-0b64-4986-8c20-7a70f2dcc40b tempest-SnapshotsActionsTest-2036197938 None] Create snapshot completed successfully Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Acquiring lock "cinder-quobyte-a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Deleting offline snapshot a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 of volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] snapshot_file for this snap is: volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac3fdb8-aa32-4eef-aac1-52e05bbd44e9]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:33 devstack sudo[84181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 Feb 26 03:02:33 devstack sudo[84181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:33 devstack sudo[84181]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9" returned: 0 in 0.463s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57900a1-9cbe-41ae-b2c6-69d4554fe4dd]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:33 devstack sudo[84186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:33 devstack sudo[84186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:34 devstack sudo[84186]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.460s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:34 devstack sudo[84191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 Feb 26 03:02:34 devstack sudo[84191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:34 devstack sudo[84191]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:34 devstack sudo[84196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9 Feb 26 03:02:34 devstack sudo[84196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:35 devstack sudo[84196]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9" returned: 0 in 0.382s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9" released by "_delete_snapshot" :: held 1.788s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" released by "delete_snapshot" :: held 1.801s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Created reservations ['a44aa1d3-df03-4124-8356-0ea2045c65d6', '7bfa2556-d4b6-4371-8968-bca9210c7157', '203f1d26-51e6-4aa3-971b-cedf68a25b8d', 'b23361bc-ca84-47b3-bc4c-f7827766bf4a'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:02:35 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Delete snapshot completed successfully. Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-08ceeea2-3558-4063-9ca7-969043a757f3 tempest-SnapshotsActionsTest-419056600 None] Lock "cinder-a9a42d9e-e6ce-4c3d-bbd7-aa5a5d21ffe9-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "cinder-ea025eaa-7ea0-4ae4-9839-3fc3112b78c1-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Lock "cinder-ea025eaa-7ea0-4ae4-9839-3fc3112b78c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "cinder-quobyte-ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Lock "cinder-quobyte-ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Deleting offline snapshot ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 of volume 0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] snapshot_file for this snap is: volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e744716-4da7-439b-b119-5c42deb285ee]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:35 devstack sudo[84199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:35 devstack sudo[84199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:36 devstack sudo[84199]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.433s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0701ffef-0589-434d-bae4-6b4d7670f5f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:36 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8574cb-ab0a-4410-8883-9e853c9737c5]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:36 devstack sudo[84204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 Feb 26 03:02:36 devstack sudo[84204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:36 devstack sudo[84204]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9" returned: 0 in 0.449s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:36 devstack sudo[84209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:36 devstack sudo[84209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:37 devstack sudo[84209]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.409s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:37 devstack sudo[84214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1 Feb 26 03:02:37 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:37 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9.ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" returned: 0 in 0.373s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Lock "cinder-quobyte-ea025eaa-7ea0-4ae4-9839-3fc3112b78c1" released by "_delete_snapshot" :: held 1.709s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" released by "delete_snapshot" :: held 1.722s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Created reservations ['1788d795-9911-4b50-a4a6-fe3ea6d0d123', 'b86e4fba-8103-4056-9e6d-44498fbc1633', 'e2769232-e0fe-4ab9-90f3-c98b3420c24b', '3c95c2c9-03e4-40d2-a6b4-a4b06e7d80a6'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:02:37 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Delete snapshot completed successfully. Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2336103d-aa47-49b5-8c6b-1dd27cd477a8 tempest-SnapshotsActionsTest-2036197938 None] Lock "cinder-ea025eaa-7ea0-4ae4-9839-3fc3112b78c1-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "cinder-0701ffef-0589-434d-bae4-6b4d7670f5f9-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Lock "cinder-0701ffef-0589-434d-bae4-6b4d7670f5f9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e10c6a-3671-4959-9acd-892c0b0b22bd]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:37 devstack sudo[84217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 Feb 26 03:02:37 devstack sudo[84217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:38 devstack sudo[84217]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:38 devstack sudo[84222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9 Feb 26 03:02:38 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:38 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0701ffef-0589-434d-bae4-6b4d7670f5f9" returned: 0 in 0.363s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Lock "cinder-quobyte-0701ffef-0589-434d-bae4-6b4d7670f5f9" released by "delete_volume" :: held 0.863s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Created reservations ['f7f683b7-7929-494e-aa44-33f4638ec7b8', '38451eab-6624-496a-883e-601ae29bee4c', 'de022928-8115-47df-9c6d-764fafae2500', 'f3210cea-ce1b-463b-8812-5f76f8a01b69'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:38 devstack sudo[84225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:02:38 devstack sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:39 devstack sudo[84225]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:39 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:02:39 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Deleted volume successfully. Feb 26 03:02:39 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-dec2e6c0-8cc3-4557-8f77-20425b8d494e tempest-SnapshotsActionsTest-2036197938 None] Lock "cinder-0701ffef-0589-434d-bae4-6b4d7670f5f9-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Flow 'volume_create_manager' (82e98218-fa0c-42f2-ac36-4795d7c70d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10eaedd-623b-4fba-8928-ef391b3e2de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10eaedd-623b-4fba-8928-ef391b3e2de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1173050691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a64670b-075a-4ba0-870a-b5f25d1001be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be37d570db24ed198bb5aaa5884dcb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:02:42Z,use_quota=True,user_id='3246e1deec5b49549c4385d3350631d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72e2e89-235a-45b0-8cac-5867f3a57055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72e2e89-235a-45b0-8cac-5867f3a57055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e07d95-8bec-45eb-a1ca-6d63b62c3d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e07d95-8bec-45eb-a1ca-6d63b62c3d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a64670b-075a-4ba0-870a-b5f25d1001be', 'volume_name': 'volume-7a64670b-075a-4ba0-870a-b5f25d1001be', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9368dfe6-d558-45b8-af00-be5a22cdf8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9368dfe6-d558-45b8-af00-be5a22cdf8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2729f0d-3291-4c28-a486-9bf7e5a5634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:41 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Volume 7a64670b-075a-4ba0-870a-b5f25d1001be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a64670b-075a-4ba0-870a-b5f25d1001be', 'volume_size': 1} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1173050691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a64670b-075a-4ba0-870a-b5f25d1001be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be37d570db24ed198bb5aaa5884dcb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:02:42Z,use_quota=True,user_id='3246e1deec5b49549c4385d3350631d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Creating volume 7a64670b-075a-4ba0-870a-b5f25d1001be {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:02:41 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:02:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:41 devstack sudo[84229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be 1073741824 Feb 26 03:02:41 devstack sudo[84229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:42 devstack sudo[84229]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be 1073741824" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:42 devstack sudo[84234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be Feb 26 03:02:42 devstack sudo[84234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:42 devstack sudo[84234]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be" returned: 0 in 0.384s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:02:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2729f0d-3291-4c28-a486-9bf7e5a5634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a64670b-075a-4ba0-870a-b5f25d1001be', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f037db-03d0-4663-aa5a-9a709ad26ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:42 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Volume volume-7a64670b-075a-4ba0-870a-b5f25d1001be (7a64670b-075a-4ba0-870a-b5f25d1001be): created successfully Feb 26 03:02:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f037db-03d0-4663-aa5a-9a709ad26ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Flow 'volume_create_manager' (82e98218-fa0c-42f2-ac36-4795d7c70d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:02:42 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-51f15434-b4c9-4363-bf54-6b06d5a32cd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Created volume successfully. Feb 26 03:02:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Creating offline snapshot 3dee5222-e38b-40da-84a3-31454ab6e8f5 of volume 7a64670b-075a-4ba0-870a-b5f25d1001be {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:02:43 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8021517f-c714-4e4f-8664-6b3a3e6b3e2d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:43 devstack sudo[84237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be Feb 26 03:02:43 devstack sudo[84237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:43 devstack sudo[84237]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:43 devstack sudo[84242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 1G Feb 26 03:02:43 devstack sudo[84242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:43 devstack sudo[84242]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 1G" returned: 0 in 0.420s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a64670b-075a-4ba0-870a-b5f25d1001be -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:43 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a64670b-075a-4ba0-870a-b5f25d1001be -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 Feb 26 03:02:43 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:44 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a64670b-075a-4ba0-870a-b5f25d1001be -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5" returned: 0 in 0.391s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:44 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 is being set with open permissions: ugo+rw Feb 26 03:02:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:44 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 Feb 26 03:02:44 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:44 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:44 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=58,cinder:UPDATE=71,cinder:INSERT=23,cinder:DELETE=3 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:02:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:44 devstack sudo[84255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.info Feb 26 03:02:44 devstack sudo[84255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:45 devstack sudo[84255]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.info" returned: 0 in 0.392s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:45 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.info is being set with open permissions: ugo+rw Feb 26 03:02:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:45 devstack sudo[84258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.info Feb 26 03:02:45 devstack sudo[84258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:45 devstack sudo[84258]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.info" returned: 0 in 0.374s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:45 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=73,cinder:UPDATE=61,cinder:DELETE=8,cinder:INSERT=15 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:02:45 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4b6e504b-6769-499c-89ea-089d974ceef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Create snapshot completed successfully Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Acquiring lock "cinder-3dee5222-e38b-40da-84a3-31454ab6e8f5-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "cinder-3dee5222-e38b-40da-84a3-31454ab6e8f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Acquiring lock "cinder-quobyte-7a64670b-075a-4ba0-870a-b5f25d1001be" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "cinder-quobyte-7a64670b-075a-4ba0-870a-b5f25d1001be" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Acquiring lock "cinder-quobyte-3dee5222-e38b-40da-84a3-31454ab6e8f5" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "cinder-quobyte-3dee5222-e38b-40da-84a3-31454ab6e8f5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Deleting offline snapshot 3dee5222-e38b-40da-84a3-31454ab6e8f5 of volume 7a64670b-075a-4ba0-870a-b5f25d1001be {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] snapshot_file for this snap is: volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4b7795-3735-443f-898a-9827bf1a452a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:46 devstack sudo[84261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 Feb 26 03:02:46 devstack sudo[84261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:46 devstack sudo[84261]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5" returned: 0 in 0.446s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a64670b-075a-4ba0-870a-b5f25d1001be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[70da944d-fed2-4d00-8359-7b15f97bab64]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:47 devstack sudo[84266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be Feb 26 03:02:47 devstack sudo[84266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:47 devstack sudo[84266]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be" returned: 0 in 0.449s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:47 devstack sudo[84271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 Feb 26 03:02:47 devstack sudo[84271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:47 devstack sudo[84271]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5" returned: 0 in 0.425s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:47 devstack sudo[84276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5 Feb 26 03:02:47 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:48 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be.3dee5222-e38b-40da-84a3-31454ab6e8f5" returned: 0 in 0.376s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "cinder-quobyte-3dee5222-e38b-40da-84a3-31454ab6e8f5" released by "_delete_snapshot" :: held 1.743s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "cinder-quobyte-7a64670b-075a-4ba0-870a-b5f25d1001be" released by "delete_snapshot" :: held 1.754s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Created reservations ['a9fc186c-92c3-433f-be7e-b051e651664a', '8d5bc624-4ca3-446a-9704-11ecb6958c90', 'f741f1bd-0d0d-4211-b421-a58b75975e2e', 'fcce0735-d275-4a84-a5e8-b6ac76b42069'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:02:48 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Delete snapshot completed successfully. Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-91ba108c-f53c-41f7-a98a-1b1026b9cf47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "cinder-3dee5222-e38b-40da-84a3-31454ab6e8f5-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Acquiring lock "cinder-7a64670b-075a-4ba0-870a-b5f25d1001be-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "cinder-7a64670b-075a-4ba0-870a-b5f25d1001be-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Acquiring lock "cinder-quobyte-7a64670b-075a-4ba0-870a-b5f25d1001be" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "cinder-quobyte-7a64670b-075a-4ba0-870a-b5f25d1001be" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[341a3999-c843-4999-9bcc-15b1818a3d53]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:02:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:48 devstack sudo[84279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be Feb 26 03:02:48 devstack sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:49 devstack sudo[84279]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be" returned: 0 in 0.436s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:49 devstack sudo[84284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be Feb 26 03:02:49 devstack sudo[84284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a64670b-075a-4ba0-870a-b5f25d1001be" returned: 0 in 0.407s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:49 devstack sudo[84284]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "cinder-quobyte-7a64670b-075a-4ba0-870a-b5f25d1001be" released by "delete_volume" :: held 0.883s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Created reservations ['ffc51ae7-1981-452c-b849-54473dc95e68', 'b977a716-2a4f-4668-aad5-59f43e1f90dc', 'e46decdd-207a-4ec4-92c5-ceb65b0e1a5d', '2cca5616-e58a-4ac6-b6fa-6eba257ed3ac'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:49 devstack sudo[84287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:02:49 devstack sudo[84287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:50 devstack sudo[84287]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.454s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:50 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:02:50 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Deleted volume successfully. Feb 26 03:02:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-051a812e-ae5d-409c-b471-134437c4954d tempest-VolumeSnapshotQuotasNegativeTestJSON-1000447020 None] Lock "cinder-7a64670b-075a-4ba0-870a-b5f25d1001be-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Flow 'volume_create_manager' (9b2add60-629f-4775-bb92-160ab1940748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e77f3b-838d-4f8a-ad26-417ed556405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e77f3b-838d-4f8a-ad26-417ed556405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-905089789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165c8bb8-3250-4636-b714-a5d4e2846abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf9604b28224e5ba4e7d0164e22c310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:02:56Z,use_quota=True,user_id='31b5ac2bd0c14d12b557596edf7e6629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd38aed8-aa3b-40a0-822d-2f6f5a146cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd38aed8-aa3b-40a0-822d-2f6f5a146cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f09eca9-6dbe-4c0f-afac-b45538754e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f09eca9-6dbe-4c0f-afac-b45538754e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165c8bb8-3250-4636-b714-a5d4e2846abc', 'volume_name': 'volume-165c8bb8-3250-4636-b714-a5d4e2846abc', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce1c54f-c99e-4232-9a2c-f4c599ddeb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce1c54f-c99e-4232-9a2c-f4c599ddeb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb0ca54-d224-4fa2-b5e3-f613b4119088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:55 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Volume 165c8bb8-3250-4636-b714-a5d4e2846abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165c8bb8-3250-4636-b714-a5d4e2846abc', 'volume_size': 1} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-905089789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165c8bb8-3250-4636-b714-a5d4e2846abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf9604b28224e5ba4e7d0164e22c310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:02:56Z,use_quota=True,user_id='31b5ac2bd0c14d12b557596edf7e6629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Creating volume 165c8bb8-3250-4636-b714-a5d4e2846abc {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:02:55 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:02:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:55 devstack sudo[84292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc 1073741824 Feb 26 03:02:55 devstack sudo[84292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:56 devstack sudo[84292]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc 1073741824" returned: 0 in 0.429s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:56 devstack sudo[84298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc Feb 26 03:02:56 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:56 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc" returned: 0 in 0.409s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:56 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:02:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb0ca54-d224-4fa2-b5e3-f613b4119088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165c8bb8-3250-4636-b714-a5d4e2846abc', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a17af3c-9284-48ca-a67b-426e0f67b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:56 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Volume volume-165c8bb8-3250-4636-b714-a5d4e2846abc (165c8bb8-3250-4636-b714-a5d4e2846abc): created successfully Feb 26 03:02:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a17af3c-9284-48ca-a67b-426e0f67b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Flow 'volume_create_manager' (9b2add60-629f-4775-bb92-160ab1940748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:02:56 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9d28189e-1274-433c-b3a9-6bb3227b0c8d tempest-VolumesListAdminTestJSON-1935985620 None] Created volume successfully. Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Flow 'volume_create_manager' (b7c1e14b-ceb5-4777-bda9-3e242dcab60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b291db8d-36e6-462e-b5f6-a0476bfcd237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b291db8d-36e6-462e-b5f6-a0476bfcd237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-813964390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738942be-f989-4475-b74b-990e277ba9e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf9604b28224e5ba4e7d0164e22c310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:02:57Z,use_quota=True,user_id='31b5ac2bd0c14d12b557596edf7e6629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee1c20e-0730-4de3-ab26-5e9551ebb5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee1c20e-0730-4de3-ab26-5e9551ebb5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fadbb8-af73-4a23-bbf4-7c5780480a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fadbb8-af73-4a23-bbf4-7c5780480a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738942be-f989-4475-b74b-990e277ba9e9', 'volume_name': 'volume-738942be-f989-4475-b74b-990e277ba9e9', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d63d2e-78f3-40de-8eb4-ee1c8515dac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d63d2e-78f3-40de-8eb4-ee1c8515dac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136668eb-4bd2-420d-9cab-010aa9e9323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:57 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Volume 738942be-f989-4475-b74b-990e277ba9e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738942be-f989-4475-b74b-990e277ba9e9', 'volume_size': 1} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-813964390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738942be-f989-4475-b74b-990e277ba9e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf9604b28224e5ba4e7d0164e22c310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:02:57Z,use_quota=True,user_id='31b5ac2bd0c14d12b557596edf7e6629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Creating volume 738942be-f989-4475-b74b-990e277ba9e9 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:02:57 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:57 devstack sudo[84324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9 1073741824 Feb 26 03:02:57 devstack sudo[84324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:57 devstack sudo[84324]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9 1073741824" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:57 devstack sudo[84330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9 Feb 26 03:02:57 devstack sudo[84330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:58 devstack sudo[84330]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9" returned: 0 in 0.386s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136668eb-4bd2-420d-9cab-010aa9e9323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738942be-f989-4475-b74b-990e277ba9e9', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46febb6f-7923-405c-990f-41d38fd13f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:58 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Volume volume-738942be-f989-4475-b74b-990e277ba9e9 (738942be-f989-4475-b74b-990e277ba9e9): created successfully Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46febb6f-7923-405c-990f-41d38fd13f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Flow 'volume_create_manager' (b7c1e14b-ceb5-4777-bda9-3e242dcab60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:02:58 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-04b4bfef-ab1b-4687-82e8-876fa02e0eb7 tempest-VolumesListAdminTestJSON-1935985620 None] Created volume successfully. Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Flow 'volume_create_manager' (c067202f-40b7-422f-b637-c5cdd6b8d9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5924ff94-9f75-4920-a115-1b2532b1cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5924ff94-9f75-4920-a115-1b2532b1cd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1903595044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2a1c99-c663-4fb9-94d8-9807df7d2ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf9604b28224e5ba4e7d0164e22c310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:02:58Z,use_quota=True,user_id='31b5ac2bd0c14d12b557596edf7e6629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2596df19-a9d2-4877-aed2-5b2eb8669467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2596df19-a9d2-4877-aed2-5b2eb8669467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fece6a-4e59-401b-8ce7-8f94e1ce0af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fece6a-4e59-401b-8ce7-8f94e1ce0af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2a1c99-c663-4fb9-94d8-9807df7d2ad7', 'volume_name': 'volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e79620-8bfe-4a3e-a099-97e38c943d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e79620-8bfe-4a3e-a099-97e38c943d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1738e089-ef38-4056-9695-6eb4f4de5144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:58 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Volume 3e2a1c99-c663-4fb9-94d8-9807df7d2ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7', 'volume_size': 1} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1903595044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2a1c99-c663-4fb9-94d8-9807df7d2ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf9604b28224e5ba4e7d0164e22c310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:02:58Z,use_quota=True,user_id='31b5ac2bd0c14d12b557596edf7e6629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Creating volume 3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:02:58 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:02:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:58 devstack sudo[84333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 1073741824 Feb 26 03:02:58 devstack sudo[84333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:59 devstack sudo[84333]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 1073741824" returned: 0 in 0.449s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:02:59 devstack sudo[84338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 Feb 26 03:02:59 devstack sudo[84338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:02:59 devstack sudo[84338]: pam_unix(sudo:session): session closed for user root Feb 26 03:02:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7" returned: 0 in 0.381s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:02:59 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:02:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:02:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1738e089-ef38-4056-9695-6eb4f4de5144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b10d0e9-e34c-4a25-9693-9d227896653d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:02:59 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Volume volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 (3e2a1c99-c663-4fb9-94d8-9807df7d2ad7): created successfully Feb 26 03:02:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b10d0e9-e34c-4a25-9693-9d227896653d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:02:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Flow 'volume_create_manager' (c067202f-40b7-422f-b637-c5cdd6b8d9d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:02:59 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4edc50fa-1966-4bba-9a09-8bdd20879f56 tempest-VolumesListAdminTestJSON-1935985620 None] Created volume successfully. Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Flow 'volume_create_manager' (86fda776-621a-4e20-873a-477a5ab17fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f45f37-df7b-4e8b-9f88-b59abe241506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f45f37-df7b-4e8b-9f88-b59abe241506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cd1499-d357-4a71-bdc6-ea06e598d8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeba1f37c83141338b88fa8bd7631ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:03:01Z,use_quota=True,user_id='febfcbdd5d4242d18eab59407999e81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf94db5e-47af-4b49-96b5-47b9924d958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf94db5e-47af-4b49-96b5-47b9924d958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac2305b-6c55-4181-9cae-2c2f73c8d71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac2305b-6c55-4181-9cae-2c2f73c8d71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43cd1499-d357-4a71-bdc6-ea06e598d8be', 'volume_name': 'volume-43cd1499-d357-4a71-bdc6-ea06e598d8be', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05a3ccf-2dfa-46c2-bb76-8714d3054c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05a3ccf-2dfa-46c2-bb76-8714d3054c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bcd6d3e-1e79-41b0-87eb-65041210eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:00 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Volume 43cd1499-d357-4a71-bdc6-ea06e598d8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43cd1499-d357-4a71-bdc6-ea06e598d8be', 'volume_size': 1} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cd1499-d357-4a71-bdc6-ea06e598d8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeba1f37c83141338b88fa8bd7631ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:03:01Z,use_quota=True,user_id='febfcbdd5d4242d18eab59407999e81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Creating volume 43cd1499-d357-4a71-bdc6-ea06e598d8be {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:03:00 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:03:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:00 devstack sudo[84341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be 1073741824 Feb 26 03:03:00 devstack sudo[84341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:01 devstack sudo[84341]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be 1073741824" returned: 0 in 0.456s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:01 devstack sudo[84347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be Feb 26 03:03:01 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:01 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be" returned: 0 in 0.381s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bcd6d3e-1e79-41b0-87eb-65041210eada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43cd1499-d357-4a71-bdc6-ea06e598d8be', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6376e7-700a-444a-8285-208bc18a5533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:01 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Volume volume-43cd1499-d357-4a71-bdc6-ea06e598d8be (43cd1499-d357-4a71-bdc6-ea06e598d8be): created successfully Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6376e7-700a-444a-8285-208bc18a5533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Flow 'volume_create_manager' (86fda776-621a-4e20-873a-477a5ab17fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:03:01 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-54a5e4ee-f40f-4e21-9130-d578454d69ca tempest-VolumesListAdminTestJSON-1970433901 None] Created volume successfully. Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Acquiring lock "cinder-43cd1499-d357-4a71-bdc6-ea06e598d8be-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Lock "cinder-43cd1499-d357-4a71-bdc6-ea06e598d8be-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Acquiring lock "cinder-quobyte-43cd1499-d357-4a71-bdc6-ea06e598d8be" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Lock "cinder-quobyte-43cd1499-d357-4a71-bdc6-ea06e598d8be" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[64abc3f1-18a9-4ed4-a786-7330a719ab33]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "cinder-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:02 devstack sudo[84350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be Feb 26 03:03:02 devstack sudo[84350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "cinder-quobyte-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-quobyte-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd40cc0-1dfa-4fef-9aec-2d0510b9a62c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:02 devstack sudo[84352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 Feb 26 03:03:02 devstack sudo[84352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:02 devstack sudo[84350]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be" returned: 0 in 0.515s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:02 devstack sudo[84357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be Feb 26 03:03:02 devstack sudo[84357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:02 devstack sudo[84352]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7" returned: 0 in 0.479s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:02 devstack sudo[84362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7 Feb 26 03:03:02 devstack sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:02 devstack sudo[84357]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-43cd1499-d357-4a71-bdc6-ea06e598d8be" returned: 0 in 0.385s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Lock "cinder-quobyte-43cd1499-d357-4a71-bdc6-ea06e598d8be" released by "delete_volume" :: held 0.925s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Created reservations ['6b9e6c71-cd50-499b-87c7-8ef108a8ab6e', '9e774f81-2c6b-4c55-88d2-fff88b489dc7', '0eb96e24-7ae7-4dc0-ad14-421ef2071d11', '6c82ab1e-7b57-470b-990e-f4ac5481883f'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:02 devstack sudo[84366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:03:02 devstack sudo[84366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:03 devstack sudo[84362]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7" returned: 0 in 0.415s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-quobyte-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7" released by "delete_volume" :: held 0.931s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Created reservations ['ccf4e43b-4c80-4878-983d-dc16e0cb603d', 'e34de980-da78-4495-9988-424b98c957f2', 'd4a0d228-567f-4af2-93cb-a82c8898ac83', '9f388ba6-22a8-4b4e-ae34-943b133a6fa1'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:03 devstack sudo[84368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:03:03 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "cinder-738942be-f989-4475-b74b-990e277ba9e9-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-738942be-f989-4475-b74b-990e277ba9e9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "cinder-quobyte-738942be-f989-4475-b74b-990e277ba9e9" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-quobyte-738942be-f989-4475-b74b-990e277ba9e9" acquired by "delete_volume" :: waited 0.014s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a2a1f-192e-47fc-811c-bbdb9e500903]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:03 devstack sudo[84366]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.433s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:03:03 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Deleted volume successfully. Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bb53a77e-cdb5-4a72-a114-f718f1bdc179 tempest-VolumesListAdminTestJSON-1970433901 None] Lock "cinder-43cd1499-d357-4a71-bdc6-ea06e598d8be-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:03 devstack sudo[84371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9 Feb 26 03:03:03 devstack sudo[84371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:03 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.488s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:03:03 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Deleted volume successfully. Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a4be29db-1d3b-4868-90a0-b361b9a3316c tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-3e2a1c99-c663-4fb9-94d8-9807df7d2ad7-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:03 devstack sudo[84371]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9" returned: 0 in 0.520s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:03 devstack sudo[84377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9 Feb 26 03:03:03 devstack sudo[84377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:04 devstack sudo[84377]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-738942be-f989-4475-b74b-990e277ba9e9" returned: 0 in 0.367s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-quobyte-738942be-f989-4475-b74b-990e277ba9e9" released by "delete_volume" :: held 0.916s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Created reservations ['98e64971-d755-4c2d-bac0-b6219816031f', 'a83c21be-2a3e-4a1c-941f-59c01d878be7', 'd7493cd7-e9a7-41b9-ad2f-e89f1713a1bf', 'b94cd1b6-9e3b-4d33-9e4b-b0e252fa93b3'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:04 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:03:04 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "cinder-165c8bb8-3250-4636-b714-a5d4e2846abc-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-165c8bb8-3250-4636-b714-a5d4e2846abc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "cinder-quobyte-165c8bb8-3250-4636-b714-a5d4e2846abc" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-quobyte-165c8bb8-3250-4636-b714-a5d4e2846abc" acquired by "delete_volume" :: waited 0.017s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c5fa46-e89d-40ed-9cca-2a175aa30a3b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:04 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc Feb 26 03:03:04 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:04 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.446s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:03:04 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Deleted volume successfully. Feb 26 03:03:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8075e95b-bef8-4a4b-ac59-33b0047fcf88 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-738942be-f989-4475-b74b-990e277ba9e9-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:05 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc" returned: 0 in 0.520s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:05 devstack sudo[84388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc Feb 26 03:03:05 devstack sudo[84388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:05 devstack sudo[84388]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-165c8bb8-3250-4636-b714-a5d4e2846abc" returned: 0 in 0.368s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-quobyte-165c8bb8-3250-4636-b714-a5d4e2846abc" released by "delete_volume" :: held 0.909s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Created reservations ['78abe6bf-fc37-4258-925b-5d8675ac5b99', '07b42231-fda9-43ae-b6be-0a74f484edda', 'ab8ba7c1-0328-4c90-81de-d44c7e1daece', 'b9261dbd-7dfa-4132-aec9-6baa05f18b7b'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:05 devstack sudo[84391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:03:05 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:06 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.493s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:06 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:03:06 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Deleted volume successfully. Feb 26 03:03:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fd520f7d-bb7b-4d91-8988-4525dae20786 tempest-VolumesListAdminTestJSON-1935985620 None] Lock "cinder-165c8bb8-3250-4636-b714-a5d4e2846abc-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Flow 'volume_create_manager' (b67a213c-a7f9-4e06-8cb8-ddcbd60df538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2dcc12-423a-4269-b11a-8af849ce271e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2dcc12-423a-4269-b11a-8af849ce271e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1883335050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407f4df4-13eb-4e8e-8092-e53eda76dbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ded990fc3cf447d86bcf62f958db098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:03:11Z,use_quota=True,user_id='d348559a0a1c4156a4c17eaefb5a6baa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39df26d5-b7d5-4fd9-8b5b-9a6844b63858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39df26d5-b7d5-4fd9-8b5b-9a6844b63858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fe83c4-0ea9-4db7-ac0c-85e97de155ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fe83c4-0ea9-4db7-ac0c-85e97de155ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407f4df4-13eb-4e8e-8092-e53eda76dbca', 'volume_name': 'volume-407f4df4-13eb-4e8e-8092-e53eda76dbca', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0015bb39-bbd0-4797-ab89-ef636023c8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0015bb39-bbd0-4797-ab89-ef636023c8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fa33ab-5b35-44c4-982e-b3c3e7551958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:11 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Volume 407f4df4-13eb-4e8e-8092-e53eda76dbca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407f4df4-13eb-4e8e-8092-e53eda76dbca', 'volume_size': 1} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1883335050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407f4df4-13eb-4e8e-8092-e53eda76dbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ded990fc3cf447d86bcf62f958db098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:03:11Z,use_quota=True,user_id='d348559a0a1c4156a4c17eaefb5a6baa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Creating volume 407f4df4-13eb-4e8e-8092-e53eda76dbca {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:03:11 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:11 devstack sudo[84436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca 1073741824 Feb 26 03:03:11 devstack sudo[84436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:11 devstack sudo[84436]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca 1073741824" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:11 devstack sudo[84441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca Feb 26 03:03:11 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:12 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca" returned: 0 in 0.388s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:12 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:03:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fa33ab-5b35-44c4-982e-b3c3e7551958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407f4df4-13eb-4e8e-8092-e53eda76dbca', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3889b4ae-7cff-43b6-9b80-84c5dd914db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:12 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Volume volume-407f4df4-13eb-4e8e-8092-e53eda76dbca (407f4df4-13eb-4e8e-8092-e53eda76dbca): created successfully Feb 26 03:03:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3889b4ae-7cff-43b6-9b80-84c5dd914db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Flow 'volume_create_manager' (b67a213c-a7f9-4e06-8cb8-ddcbd60df538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:03:12 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-67b244ba-aa71-46f6-855b-707df70aac9d tempest-VolumesTransfersV357Test-2052772394 None] Created volume successfully. Feb 26 03:03:13 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-42d17127-7d69-418e-b607-681c0cdb2f30 tempest-VolumesTransfersV357Test-1523527058 None] Transfer volume completed successfully. Feb 26 03:03:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Acquiring lock "cinder-407f4df4-13eb-4e8e-8092-e53eda76dbca-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Lock "cinder-407f4df4-13eb-4e8e-8092-e53eda76dbca-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Acquiring lock "cinder-quobyte-407f4df4-13eb-4e8e-8092-e53eda76dbca" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Lock "cinder-quobyte-407f4df4-13eb-4e8e-8092-e53eda76dbca" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:14 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d532019a-7984-4ce0-af57-18becb51c56d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:03:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:14 devstack sudo[84445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca Feb 26 03:03:14 devstack sudo[84445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:15 devstack sudo[84445]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca" returned: 0 in 0.466s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:15 devstack sudo[84450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca Feb 26 03:03:15 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:15 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407f4df4-13eb-4e8e-8092-e53eda76dbca" returned: 0 in 0.405s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Lock "cinder-quobyte-407f4df4-13eb-4e8e-8092-e53eda76dbca" released by "delete_volume" :: held 0.892s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Created reservations ['1d03d8e1-f5d5-4f63-a342-686615b838e6', 'c2f28c1a-d012-4a67-b73c-e6cd78e48380', '0c125649-60d5-4cd2-bf5b-e670b75862a3', '5ad9a8f5-b52e-4a8d-8438-75f7fb8d7998'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:15 devstack sudo[84453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:03:15 devstack sudo[84453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:15 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Flow 'volume_create_manager' (83f800ff-ea12-470c-90a8-97d8f4812a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:03:16 devstack sudo[84453]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330dd5dd-767b-4b03-a458-8223bc9ba8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.397s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330dd5dd-767b-4b03-a458-8223bc9ba8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1897580667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd7e7cf-0606-44e3-a1ea-d8146de9ff67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ded990fc3cf447d86bcf62f958db098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:03:16Z,use_quota=True,user_id='d348559a0a1c4156a4c17eaefb5a6baa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed03aaa-80c8-44e8-9224-df8cdcf642fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed03aaa-80c8-44e8-9224-df8cdcf642fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f108ab8a-4d5c-404f-b584-69be62f98854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f108ab8a-4d5c-404f-b584-69be62f98854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd7e7cf-0606-44e3-a1ea-d8146de9ff67', 'volume_name': 'volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f8505b-3c2d-4f0f-b8fe-5328e6b914bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f8505b-3c2d-4f0f-b8fe-5328e6b914bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab897eb8-df37-45c6-8785-ae6927ee50e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:16 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Volume 8fd7e7cf-0606-44e3-a1ea-d8146de9ff67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67', 'volume_size': 1} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1897580667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd7e7cf-0606-44e3-a1ea-d8146de9ff67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ded990fc3cf447d86bcf62f958db098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:03:16Z,use_quota=True,user_id='d348559a0a1c4156a4c17eaefb5a6baa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Creating volume 8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:03:16 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:16 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Deleted volume successfully. Feb 26 03:03:16 devstack sudo[84456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 1073741824 Feb 26 03:03:16 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be734950-9a0b-42e3-b005-45538bd13345 tempest-VolumesTransfersV357Test-609495045 None] Lock "cinder-407f4df4-13eb-4e8e-8092-e53eda76dbca-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:16 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 1073741824" returned: 0 in 0.464s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:16 devstack sudo[84461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 Feb 26 03:03:16 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:16 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67" returned: 0 in 0.398s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab897eb8-df37-45c6-8785-ae6927ee50e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4d2c67-8bcb-4349-9198-369e1a52ea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:16 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Volume volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 (8fd7e7cf-0606-44e3-a1ea-d8146de9ff67): created successfully Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4d2c67-8bcb-4349-9198-369e1a52ea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Flow 'volume_create_manager' (83f800ff-ea12-470c-90a8-97d8f4812a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:03:16 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-ed0ac84f-88ec-4ea0-bddd-44c7e2521c20 tempest-VolumesTransfersV357Test-2052772394 None] Created volume successfully. Feb 26 03:03:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Acquiring lock "cinder-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Lock "cinder-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Acquiring lock "cinder-quobyte-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:03:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Lock "cinder-quobyte-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:03:18 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1e5b6c-65a1-4166-b89a-1a6ffd6b2cc4]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:03:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:18 devstack sudo[84464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 Feb 26 03:03:18 devstack sudo[84464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:18 devstack sudo[84464]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67" returned: 0 in 0.469s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:18 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67 Feb 26 03:03:18 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:19 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67" returned: 0 in 0.407s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Lock "cinder-quobyte-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67" released by "delete_volume" :: held 0.897s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Created reservations ['3188cd9b-747f-46c9-bfbd-78d3b4ccd565', '0b908a87-ca24-48b0-a0c7-747a0bbb58e8', '9de74aaa-29ca-4da0-9f41-eedb033025d2', '37df15da-9e8e-4fb2-94be-63878623a914'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:19 devstack sudo[84472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:03:19 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:19 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:03:19 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Deleted volume successfully. Feb 26 03:03:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-86b335bb-b1a8-43b9-aa40-e7bf4c0c7437 tempest-VolumesTransfersV357Test-609495045 None] Lock "cinder-8fd7e7cf-0606-44e3-a1ea-d8146de9ff67-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Flow 'volume_create_manager' (da37bdf1-b26e-421b-9152-d72c41b4fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fd1361-ede7-4904-90ff-5d6c588f4fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fd1361-ede7-4904-90ff-5d6c588f4fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480374800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c0cc2c-13a6-4588-9f4d-02b2adde9544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ffe9bbd9674ae1a59ad3bcc97dcde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:03:28Z,use_quota=True,user_id='8d9d210173664ecd8921d35c78727b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0342bd27-d432-4fc2-aee5-ad69ffccec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0342bd27-d432-4fc2-aee5-ad69ffccec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4039e681-f920-440c-b9e2-631e835d7ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4039e681-f920-440c-b9e2-631e835d7ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c0cc2c-13a6-4588-9f4d-02b2adde9544', 'volume_name': 'volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eaa6e10-f8a7-4f59-b92f-03031434aecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eaa6e10-f8a7-4f59-b92f-03031434aecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16782d9d-a916-44b9-8681-abd0cc2104be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:28 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Volume 48c0cc2c-13a6-4588-9f4d-02b2adde9544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544', 'volume_size': 1} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480374800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c0cc2c-13a6-4588-9f4d-02b2adde9544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81ffe9bbd9674ae1a59ad3bcc97dcde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:03:28Z,use_quota=True,user_id='8d9d210173664ecd8921d35c78727b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Creating volume 48c0cc2c-13a6-4588-9f4d-02b2adde9544 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:03:28 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:28 devstack sudo[84478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 1073741824 Feb 26 03:03:28 devstack sudo[84478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:28 devstack sudo[84478]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 1073741824" returned: 0 in 0.482s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:28 devstack sudo[84483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 Feb 26 03:03:28 devstack sudo[84483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:29 devstack sudo[84483]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544" returned: 0 in 0.402s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:03:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16782d9d-a916-44b9-8681-abd0cc2104be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fde807-f36b-4cbf-bb90-46ec727ae71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:03:29 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Volume volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 (48c0cc2c-13a6-4588-9f4d-02b2adde9544): created successfully Feb 26 03:03:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fde807-f36b-4cbf-bb90-46ec727ae71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:03:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Flow 'volume_create_manager' (da37bdf1-b26e-421b-9152-d72c41b4fd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:03:29 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-20b6a6dc-9774-4ec5-9a15-c5262572db5b tempest-VolumesActionsTest-1460120081 None] Created volume successfully. Feb 26 03:03:31 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:03:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:03:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:03:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:03:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:03:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:03:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:03:32 devstack sudo[84490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:03:32 devstack sudo[84490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:03:32 devstack sudo[84490]: pam_unix(sudo:session): session closed for user root Feb 26 03:03:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.381s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:03:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:03:39 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=84,cinder:DELETE=5,cinder:SELECT=61,cinder:INSERT=22 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:03:39 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=50,cinder:INSERT=17,cinder:UPDATE=83,cinder:DELETE=10 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:04:31 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:04:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:04:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:04:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:04:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:04:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:04:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:04:32 devstack sudo[84621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:04:32 devstack sudo[84621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:04:32 devstack sudo[84621]: pam_unix(sudo:session): session closed for user root Feb 26 03:04:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.388s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:04:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:05:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:05:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:05:31 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:05:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:05:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:05:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:05:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:05:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:05:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:05:32 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:05:32 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:05:32 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Feb 26 03:05:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.381s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:05:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:06:31 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:06:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:06:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:06:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:06:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:06:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:06:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:06:32 devstack sudo[84790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:06:32 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:06:32 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root Feb 26 03:06:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.386s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:06:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:07:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Flow 'volume_create_manager' (a397be82-a86b-4495-848f-8fc123c51d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1e64a3-d58a-400a-a69d-6ed819624d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1e64a3-d58a-400a-a69d-6ed819624d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-172590051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7aac92d-71c5-48c4-8750-5d4621bc3397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ee054af2054b8b8b3f04a412dc270a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:13Z,use_quota=True,user_id='b20ce8427cfd4cae9103c2b5c40464c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d282eb27-8ef0-4344-aeb0-c8d2b67137e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d282eb27-8ef0-4344-aeb0-c8d2b67137e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef26432e-dce7-4574-bfa9-66946c275b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef26432e-dce7-4574-bfa9-66946c275b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7aac92d-71c5-48c4-8750-5d4621bc3397', 'volume_name': 'volume-b7aac92d-71c5-48c4-8750-5d4621bc3397', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6249f418-c307-4d78-a4fe-320b37f34a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6249f418-c307-4d78-a4fe-320b37f34a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971d14b2-8dba-42c2-8fa3-f76e4731d830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:13 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Volume b7aac92d-71c5-48c4-8750-5d4621bc3397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7aac92d-71c5-48c4-8750-5d4621bc3397', 'volume_size': 1} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-172590051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7aac92d-71c5-48c4-8750-5d4621bc3397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ee054af2054b8b8b3f04a412dc270a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:13Z,use_quota=True,user_id='b20ce8427cfd4cae9103c2b5c40464c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Creating volume b7aac92d-71c5-48c4-8750-5d4621bc3397 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:07:13 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:13 devstack sudo[85015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397 1073741824 Feb 26 03:07:13 devstack sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:13 devstack sudo[85015]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397 1073741824" returned: 0 in 0.484s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:13 devstack sudo[85020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397 Feb 26 03:07:13 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:14 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397" returned: 0 in 0.428s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:14 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:07:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971d14b2-8dba-42c2-8fa3-f76e4731d830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7aac92d-71c5-48c4-8750-5d4621bc3397', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73254e2a-5387-449f-a000-7b5a7ee85f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:14 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Volume volume-b7aac92d-71c5-48c4-8750-5d4621bc3397 (b7aac92d-71c5-48c4-8750-5d4621bc3397): created successfully Feb 26 03:07:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73254e2a-5387-449f-a000-7b5a7ee85f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Flow 'volume_create_manager' (a397be82-a86b-4495-848f-8fc123c51d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:14 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-c82a5f8c-3750-4bb7-9778-128538151760 tempest-VolumeQuotasNegativeTestJSON-894751533 None] Created volume successfully. Feb 26 03:07:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Acquiring lock "cinder-b7aac92d-71c5-48c4-8750-5d4621bc3397-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Lock "cinder-b7aac92d-71c5-48c4-8750-5d4621bc3397-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Acquiring lock "cinder-quobyte-b7aac92d-71c5-48c4-8750-5d4621bc3397" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Lock "cinder-quobyte-b7aac92d-71c5-48c4-8750-5d4621bc3397" acquired by "delete_volume" :: waited 0.016s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:15 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ee48bb-3b58-4578-92be-fb23208a92b2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:16 devstack sudo[85025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397 Feb 26 03:07:16 devstack sudo[85025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:16 devstack sudo[85025]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397" returned: 0 in 0.534s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:16 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397 Feb 26 03:07:16 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:16 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b7aac92d-71c5-48c4-8750-5d4621bc3397" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Lock "cinder-quobyte-b7aac92d-71c5-48c4-8750-5d4621bc3397" released by "delete_volume" :: held 1.031s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:17 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Created reservations ['c007f76f-94b1-4873-9c08-14cd07b75e34', 'e02fb831-669b-4b45-ab8b-11232a5eb224', 'a410cfa6-2c6e-461a-a0d6-08321e04dafa', '39b2cd34-d50b-452b-9d7d-1ccfa71071bb'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:17 devstack sudo[85034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:07:17 devstack sudo[85034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:17 devstack sudo[85034]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.552s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:17 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:17 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Deleted volume successfully. Feb 26 03:07:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c31bff29-08d5-4b86-8c0b-d51ad4e488cc tempest-VolumeQuotasNegativeTestJSON-894751533 None] Lock "cinder-b7aac92d-71c5-48c4-8750-5d4621bc3397-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Flow 'volume_create_manager' (75a6a369-f0ef-4e00-a5ea-32875e8e0042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9122df20-fa86-4141-8541-3dc7be71dbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9122df20-fa86-4141-8541-3dc7be71dbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1444859093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312b536e-55e9-4d50-b609-e7a1de1687cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe207b9ea1304068b5b61ca1e7b30a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:19Z,use_quota=True,user_id='f0fdf9a82781424182ac85faecbae2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4500ba66-ea25-4301-829c-0a1ac44e4892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4500ba66-ea25-4301-829c-0a1ac44e4892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d533846-9348-4242-9cee-f22a26812a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d533846-9348-4242-9cee-f22a26812a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312b536e-55e9-4d50-b609-e7a1de1687cb', 'volume_name': 'volume-312b536e-55e9-4d50-b609-e7a1de1687cb', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce19417e-f8ec-4bad-83cb-f61bdd1c24d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce19417e-f8ec-4bad-83cb-f61bdd1c24d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee1d9c7-e36a-4fc9-88f0-c1f739addc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:19 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Volume 312b536e-55e9-4d50-b609-e7a1de1687cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312b536e-55e9-4d50-b609-e7a1de1687cb', 'volume_size': 1} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1444859093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312b536e-55e9-4d50-b609-e7a1de1687cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe207b9ea1304068b5b61ca1e7b30a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:19Z,use_quota=True,user_id='f0fdf9a82781424182ac85faecbae2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Creating volume 312b536e-55e9-4d50-b609-e7a1de1687cb {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:07:19 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:19 devstack sudo[85037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb 1073741824 Feb 26 03:07:19 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:19 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb 1073741824" returned: 0 in 0.511s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:19 devstack sudo[85042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb Feb 26 03:07:19 devstack sudo[85042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:20 devstack sudo[85042]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb" returned: 0 in 0.456s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:07:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee1d9c7-e36a-4fc9-88f0-c1f739addc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312b536e-55e9-4d50-b609-e7a1de1687cb', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1925ee23-04d9-4875-8545-ac93a7c479a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:20 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Volume volume-312b536e-55e9-4d50-b609-e7a1de1687cb (312b536e-55e9-4d50-b609-e7a1de1687cb): created successfully Feb 26 03:07:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1925ee23-04d9-4875-8545-ac93a7c479a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Flow 'volume_create_manager' (75a6a369-f0ef-4e00-a5ea-32875e8e0042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:20 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-dd04c378-7973-4ca2-9ec2-f4c1186d237c tempest-VolumesTestJSON-80097723 None] Created volume successfully. Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Flow 'volume_create_manager' (75e8f2a4-0cb9-4ff9-b595-332e7264937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44e7569-948f-4dde-877b-365def44e6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44e7569-948f-4dde-877b-365def44e6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-17440700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb425d1-609e-401b-be3a-590313196a6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe207b9ea1304068b5b61ca1e7b30a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:22Z,use_quota=True,user_id='f0fdf9a82781424182ac85faecbae2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea23195-d401-4523-a3ac-b8670141aa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea23195-d401-4523-a3ac-b8670141aa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d77e917-f5e8-472c-8539-d4125363fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d77e917-f5e8-472c-8539-d4125363fc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb425d1-609e-401b-be3a-590313196a6d', 'volume_name': 'volume-8fb425d1-609e-401b-be3a-590313196a6d', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d19426-3fbd-48a8-9c98-a715333bbdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d19426-3fbd-48a8-9c98-a715333bbdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb9035a-f3ef-4723-9bdb-4fabfaa22cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:21 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Volume 8fb425d1-609e-401b-be3a-590313196a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb425d1-609e-401b-be3a-590313196a6d', 'volume_size': 1} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-17440700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb425d1-609e-401b-be3a-590313196a6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe207b9ea1304068b5b61ca1e7b30a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:22Z,use_quota=True,user_id='f0fdf9a82781424182ac85faecbae2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Creating volume 8fb425d1-609e-401b-be3a-590313196a6d {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:07:21 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:07:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:21 devstack sudo[85046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d 1073741824 Feb 26 03:07:21 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:22 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d 1073741824" returned: 0 in 0.526s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:22 devstack sudo[85051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d Feb 26 03:07:22 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:22 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d" returned: 0 in 0.422s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:07:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb9035a-f3ef-4723-9bdb-4fabfaa22cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb425d1-609e-401b-be3a-590313196a6d', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef598530-54ee-478c-9a98-910e9f37efdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:22 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Volume volume-8fb425d1-609e-401b-be3a-590313196a6d (8fb425d1-609e-401b-be3a-590313196a6d): created successfully Feb 26 03:07:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef598530-54ee-478c-9a98-910e9f37efdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Flow 'volume_create_manager' (75e8f2a4-0cb9-4ff9-b595-332e7264937b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:22 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-27fe0298-1535-4c32-a8a5-8a08934f1646 tempest-VolumesTestJSON-80097723 None] Created volume successfully. Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Flow 'volume_create_manager' (3d169e51-4e86-4759-a2af-d6a8177db437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8155b1-6806-4eaf-bea3-3e23d442b5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8155b1-6806-4eaf-bea3-3e23d442b5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1861944906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ae602d-d864-4fe6-a330-1f17d10d6e72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe207b9ea1304068b5b61ca1e7b30a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:24Z,use_quota=True,user_id='f0fdf9a82781424182ac85faecbae2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65296947-b5c3-4e48-8359-35395a73d983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65296947-b5c3-4e48-8359-35395a73d983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a98ae7a-416e-473d-ba06-1b575271897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a98ae7a-416e-473d-ba06-1b575271897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ae602d-d864-4fe6-a330-1f17d10d6e72', 'volume_name': 'volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d9ecc7-6f6a-4257-8c3d-4572959d0c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d9ecc7-6f6a-4257-8c3d-4572959d0c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a6acc3-4876-4511-aa9e-b7f38921f286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:24 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Volume f9ae602d-d864-4fe6-a330-1f17d10d6e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72', 'volume_size': 1} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1861944906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ae602d-d864-4fe6-a330-1f17d10d6e72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe207b9ea1304068b5b61ca1e7b30a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:24Z,use_quota=True,user_id='f0fdf9a82781424182ac85faecbae2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Creating volume f9ae602d-d864-4fe6-a330-1f17d10d6e72 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:07:24 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:24 devstack sudo[85054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72 1073741824 Feb 26 03:07:24 devstack sudo[85054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:24 devstack sudo[85054]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72 1073741824" returned: 0 in 0.506s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:24 devstack sudo[85059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72 Feb 26 03:07:24 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:25 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72" returned: 0 in 0.461s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:07:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a6acc3-4876-4511-aa9e-b7f38921f286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05f7df8-0fd1-4ab5-85b4-10f4431013b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:25 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Volume volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72 (f9ae602d-d864-4fe6-a330-1f17d10d6e72): created successfully Feb 26 03:07:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05f7df8-0fd1-4ab5-85b4-10f4431013b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Flow 'volume_create_manager' (3d169e51-4e86-4759-a2af-d6a8177db437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:25 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8c170169-2873-434e-8dc2-ff1bbe22ae5c tempest-VolumesTestJSON-80097723 None] Created volume successfully. Feb 26 03:07:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Acquiring lock "cinder-f9ae602d-d864-4fe6-a330-1f17d10d6e72-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Lock "cinder-f9ae602d-d864-4fe6-a330-1f17d10d6e72-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Acquiring lock "cinder-quobyte-f9ae602d-d864-4fe6-a330-1f17d10d6e72" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Lock "cinder-quobyte-f9ae602d-d864-4fe6-a330-1f17d10d6e72" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:26 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99265c4-8e56-4805-a810-86a228b5e64d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:26 devstack sudo[85064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72 Feb 26 03:07:26 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:27 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72" returned: 0 in 0.501s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:27 devstack sudo[85069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72 Feb 26 03:07:27 devstack sudo[85069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:27 devstack sudo[85069]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9ae602d-d864-4fe6-a330-1f17d10d6e72" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Lock "cinder-quobyte-f9ae602d-d864-4fe6-a330-1f17d10d6e72" released by "delete_volume" :: held 0.972s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Created reservations ['5d816c25-ba54-43cd-8d4d-edf3cf1cf5df', 'c5d7043b-848e-420e-a177-37d82cc38633', '84c1f6e9-c269-451b-926a-28a3c7f9679f', '8b9d79cd-fa4c-4b83-bd23-10a8ab5f6b43'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:27 devstack sudo[85072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:07:27 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Acquiring lock "cinder-8fb425d1-609e-401b-be3a-590313196a6d-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Lock "cinder-8fb425d1-609e-401b-be3a-590313196a6d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Acquiring lock "cinder-quobyte-8fb425d1-609e-401b-be3a-590313196a6d" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Flow 'volume_create_manager' (c57f66ff-c17e-407c-81a3-c69afd18ab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f67773-75f3-4e60-b456-063cd9ef9a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f67773-75f3-4e60-b456-063cd9ef9a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-238379264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436babc8-99ea-43af-9095-63cb7a272f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f598b451594723b5dfdb755059f767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:28Z,use_quota=True,user_id='a9d5d6b9d6a24e59be968420a8dfb956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945fa522-393f-480b-ab49-e82bc2c836cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945fa522-393f-480b-ab49-e82bc2c836cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d769203-e320-40a7-a50c-9a5ed68852df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d769203-e320-40a7-a50c-9a5ed68852df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '436babc8-99ea-43af-9095-63cb7a272f4a', 'volume_name': 'volume-436babc8-99ea-43af-9095-63cb7a272f4a', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abee1d7d-4622-44d7-aaa9-f9748309fa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abee1d7d-4622-44d7-aaa9-f9748309fa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf647372-7c17-406c-b5e3-afb2055ecd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:28 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Volume 436babc8-99ea-43af-9095-63cb7a272f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-436babc8-99ea-43af-9095-63cb7a272f4a', 'volume_size': 1} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-238379264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436babc8-99ea-43af-9095-63cb7a272f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f598b451594723b5dfdb755059f767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:28Z,use_quota=True,user_id='a9d5d6b9d6a24e59be968420a8dfb956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Creating volume 436babc8-99ea-43af-9095-63cb7a272f4a {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:07:28 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Lock "cinder-quobyte-8fb425d1-609e-401b-be3a-590313196a6d" acquired by "delete_volume" :: waited 0.070s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:28 devstack sudo[85075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a 1073741824 Feb 26 03:07:28 devstack sudo[85075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dc3aec-c428-4a8e-b7f6-05c083ec387b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:28 devstack sudo[85077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d Feb 26 03:07:28 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:28 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.513s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:28 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Deleted volume successfully. Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6556936c-1211-4696-9a0d-a942145812d2 tempest-VolumesTestJSON-80097723 None] Lock "cinder-f9ae602d-d864-4fe6-a330-1f17d10d6e72-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:28 devstack sudo[85075]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a 1073741824" returned: 0 in 0.474s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:28 devstack sudo[85086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a Feb 26 03:07:28 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:28 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d" returned: 0 in 0.516s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:28 devstack sudo[85088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d Feb 26 03:07:28 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:28 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a" returned: 0 in 0.388s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:07:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf647372-7c17-406c-b5e3-afb2055ecd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-436babc8-99ea-43af-9095-63cb7a272f4a', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6650935d-4cc0-4a7b-8a27-680305553b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:29 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Volume volume-436babc8-99ea-43af-9095-63cb7a272f4a (436babc8-99ea-43af-9095-63cb7a272f4a): created successfully Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6650935d-4cc0-4a7b-8a27-680305553b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Flow 'volume_create_manager' (c57f66ff-c17e-407c-81a3-c69afd18ab33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:29 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-222ea888-9581-4fdf-b4fa-4baaf9bce630 tempest-SnapshotMetadataTestJSON-477171866 None] Created volume successfully. Feb 26 03:07:29 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8fb425d1-609e-401b-be3a-590313196a6d" returned: 0 in 0.402s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Lock "cinder-quobyte-8fb425d1-609e-401b-be3a-590313196a6d" released by "delete_volume" :: held 0.946s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Created reservations ['4695c6de-e6de-4906-a099-3a6c8556f1bd', '1c2de845-c707-4f16-b4db-95edf34fed7e', 'a1bf239e-8190-4a1e-8ebf-980a499646e9', '85d8b7d2-957a-4432-a3fb-cce393ebdbef'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:29 devstack sudo[85092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:07:29 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Creating offline snapshot 3ee661b5-9653-4b01-873e-33290aacca5f of volume 436babc8-99ea-43af-9095-63cb7a272f4a {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaf3c7f-1e6c-4af9-b969-f88f576516a7]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:29 devstack sudo[85094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a Feb 26 03:07:29 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:29 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.407s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:29 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Deleted volume successfully. Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2b67c737-428c-463b-a291-e246e48ddbe6 tempest-VolumesTestJSON-80097723 None] Lock "cinder-8fb425d1-609e-401b-be3a-590313196a6d-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:29 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a" returned: 0 in 0.474s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:29 devstack sudo[85100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f 1G Feb 26 03:07:29 devstack sudo[85100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Acquiring lock "cinder-312b536e-55e9-4d50-b609-e7a1de1687cb-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:30 devstack sudo[85100]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f 1G" returned: 0 in 0.437s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-436babc8-99ea-43af-9095-63cb7a272f4a -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Lock "cinder-312b536e-55e9-4d50-b609-e7a1de1687cb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:30 devstack sudo[85105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-436babc8-99ea-43af-9095-63cb7a272f4a -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f Feb 26 03:07:30 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Acquiring lock "cinder-quobyte-312b536e-55e9-4d50-b609-e7a1de1687cb" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Lock "cinder-quobyte-312b536e-55e9-4d50-b609-e7a1de1687cb" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a9d5db-fc9f-4cc8-bef9-5743fbbb2a2a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:30 devstack sudo[85107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb Feb 26 03:07:30 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:30 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-436babc8-99ea-43af-9095-63cb7a272f4a -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f" returned: 0 in 0.436s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:30 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f is being set with open permissions: ugo+rw Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:30 devstack sudo[85112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f Feb 26 03:07:30 devstack sudo[85112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:30 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb" returned: 0 in 0.482s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:30 devstack sudo[85117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb Feb 26 03:07:30 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:31 devstack sudo[85112]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f" returned: 0 in 0.397s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:31 devstack sudo[85120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.info Feb 26 03:07:31 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:31 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-312b536e-55e9-4d50-b609-e7a1de1687cb" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Lock "cinder-quobyte-312b536e-55e9-4d50-b609-e7a1de1687cb" released by "delete_volume" :: held 0.906s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Created reservations ['9892ea25-d46a-423c-a9ae-53ed427c5f3f', '22755ecd-677b-4fb7-9c74-087cb18a3d95', '2fe66a96-ac24-41a6-857e-f2745fd7cd49', '0e4456e3-c3ea-4d8c-9fcd-19c13460959e'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:31 devstack sudo[85124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:07:31 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:31 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.info" returned: 0 in 0.423s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:31 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.info is being set with open permissions: ugo+rw Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:31 devstack sudo[85127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.info Feb 26 03:07:31 devstack sudo[85127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:31 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:31 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Deleted volume successfully. Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90213234-977f-4541-aa8b-316a324128fd tempest-VolumesTestJSON-80097723 None] Lock "cinder-312b536e-55e9-4d50-b609-e7a1de1687cb-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:31 devstack sudo[85127]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.info" returned: 0 in 0.437s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:31 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0d0b8970-c166-4b3f-9117-6a5da8d7d763 tempest-SnapshotMetadataTestJSON-477171866 None] Create snapshot completed successfully Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:32 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:07:32 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:32 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.465s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Acquiring lock "cinder-3ee661b5-9653-4b01-873e-33290aacca5f-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Lock "cinder-3ee661b5-9653-4b01-873e-33290aacca5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Acquiring lock "cinder-quobyte-436babc8-99ea-43af-9095-63cb7a272f4a" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Lock "cinder-quobyte-436babc8-99ea-43af-9095-63cb7a272f4a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Acquiring lock "cinder-quobyte-3ee661b5-9653-4b01-873e-33290aacca5f" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Lock "cinder-quobyte-3ee661b5-9653-4b01-873e-33290aacca5f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Deleting offline snapshot 3ee661b5-9653-4b01-873e-33290aacca5f of volume 436babc8-99ea-43af-9095-63cb7a272f4a {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] snapshot_file for this snap is: volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc869c52-f7e3-4315-a923-b547aad11ea3]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:33 devstack sudo[85134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f Feb 26 03:07:33 devstack sudo[85134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:33 devstack sudo[85134]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f" returned: 0 in 0.539s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-436babc8-99ea-43af-9095-63cb7a272f4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:07:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f73de9-d2f5-4237-a208-bc03b2fe1b4b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:33 devstack sudo[85139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a Feb 26 03:07:33 devstack sudo[85139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-065fba0b-96f2-4057-b4ed-b8a20a32d80e tempest-GroupSnapshotsTest-681902376 None] Group tempest-GroupSnapshotsTest-Group-321135455: creating Feb 26 03:07:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-065fba0b-96f2-4057-b4ed-b8a20a32d80e tempest-GroupSnapshotsTest-681902376 None] Group tempest-GroupSnapshotsTest-Group-321135455: created successfully Feb 26 03:07:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-065fba0b-96f2-4057-b4ed-b8a20a32d80e tempest-GroupSnapshotsTest-681902376 None] Create group completed successfully. Feb 26 03:07:34 devstack sudo[85139]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a" returned: 0 in 0.500s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:34 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f Feb 26 03:07:34 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:34 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f" returned: 0 in 0.446s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:34 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f Feb 26 03:07:34 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:34 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a.3ee661b5-9653-4b01-873e-33290aacca5f" returned: 0 in 0.405s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Lock "cinder-quobyte-3ee661b5-9653-4b01-873e-33290aacca5f" released by "_delete_snapshot" :: held 1.954s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Lock "cinder-quobyte-436babc8-99ea-43af-9095-63cb7a272f4a" released by "delete_snapshot" :: held 1.966s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:34 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Created reservations ['3bb06550-cc5a-4101-8a7c-2d9fbec21e42', '43d5ed3b-e1bd-4e2e-95a9-a15e7a134ecd', '3ae2ad24-0f33-4add-8723-811d55272766', 'cb7d36a9-e839-47c5-80bc-f6ba93a90208'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:34 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Delete snapshot completed successfully. Feb 26 03:07:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9543b52e-cfff-4745-b404-63aa9506253f tempest-SnapshotMetadataTestJSON-477171866 None] Lock "cinder-3ee661b5-9653-4b01-873e-33290aacca5f-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Flow 'volume_create_manager' (89742d45-968d-43bb-a062-27767d9e0fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003902f4-6eb7-4ad4-928a-147b9f5e7db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Acquiring lock "cinder-436babc8-99ea-43af-9095-63cb7a272f4a-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003902f4-6eb7-4ad4-928a-147b9f5e7db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1712839221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bdaaead0-b22a-47ee-8254-8f1a6f890cd1,host='devstack@QuobyteHD#QuobyteHD',id=17474c0a-4352-46ee-b008-01ce25c6f878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c911722a4c4f35934b05c9a2b91bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:35Z,use_quota=True,user_id='ffd3dc0ab6cc47588ae8ac57768ff25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9829e762-1c3a-4fae-b525-238182d2a61d),volume_type_id=9829e762-1c3a-4fae-b525-238182d2a61d)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1326fa-553a-4aeb-a9c9-1f156fff558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1326fa-553a-4aeb-a9c9-1f156fff558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e4f29e-c72d-41da-9e8e-8620059d7677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e4f29e-c72d-41da-9e8e-8620059d7677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17474c0a-4352-46ee-b008-01ce25c6f878', 'volume_name': 'volume-17474c0a-4352-46ee-b008-01ce25c6f878', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c6ad8e-4aaf-4ff7-ae75-c0b6be1c53f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c6ad8e-4aaf-4ff7-ae75-c0b6be1c53f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cf39fa-9758-4d2e-b003-3c29e42fb144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:35 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Volume 17474c0a-4352-46ee-b008-01ce25c6f878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17474c0a-4352-46ee-b008-01ce25c6f878', 'volume_size': 1} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bdaaead0-b22a-47ee-8254-8f1a6f890cd1,created_at=2026-02-26T02:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1712839221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bdaaead0-b22a-47ee-8254-8f1a6f890cd1,host='devstack@QuobyteHD#QuobyteHD',id=17474c0a-4352-46ee-b008-01ce25c6f878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c911722a4c4f35934b05c9a2b91bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:35Z,use_quota=True,user_id='ffd3dc0ab6cc47588ae8ac57768ff25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9829e762-1c3a-4fae-b525-238182d2a61d),volume_type_id=9829e762-1c3a-4fae-b525-238182d2a61d)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Creating volume 17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:07:35 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:35 devstack sudo[85152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 1073741824 Feb 26 03:07:35 devstack sudo[85152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "cinder-436babc8-99ea-43af-9095-63cb7a272f4a-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Acquiring lock "cinder-quobyte-436babc8-99ea-43af-9095-63cb7a272f4a" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "cinder-quobyte-436babc8-99ea-43af-9095-63cb7a272f4a" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59b3a14-4617-448b-b551-da1226ca74e4]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:35 devstack sudo[85154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a Feb 26 03:07:35 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:35 devstack sudo[85152]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 1073741824" returned: 0 in 0.534s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:35 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:35 devstack sudo[85162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 Feb 26 03:07:35 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a" returned: 0 in 0.484s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:35 devstack sudo[85164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a Feb 26 03:07:35 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:36 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878" returned: 0 in 0.386s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cf39fa-9758-4d2e-b003-3c29e42fb144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17474c0a-4352-46ee-b008-01ce25c6f878', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ca95c3-f0a1-4985-b314-10d22cf5a0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:36 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Volume volume-17474c0a-4352-46ee-b008-01ce25c6f878 (17474c0a-4352-46ee-b008-01ce25c6f878): created successfully Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ca95c3-f0a1-4985-b314-10d22cf5a0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Flow 'volume_create_manager' (89742d45-968d-43bb-a062-27767d9e0fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:36 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-85575c62-b492-44aa-9e65-8f4ca2e6e35f tempest-GroupSnapshotsTest-681902376 None] Created volume successfully. Feb 26 03:07:36 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-436babc8-99ea-43af-9095-63cb7a272f4a" returned: 0 in 0.409s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "cinder-quobyte-436babc8-99ea-43af-9095-63cb7a272f4a" released by "delete_volume" :: held 0.922s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Created reservations ['329ae966-7f85-4c64-a26e-4d020a5415f2', '969e44f4-11df-49dd-a748-e6f976e49092', '91429fb3-6431-49b0-a155-ac68bde33238', '84d0481b-5cf9-4984-8050-80d5303e0ec5'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:36 devstack sudo[85168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:07:36 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:36 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.493s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:36 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Deleted volume successfully. Feb 26 03:07:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4be0dde6-0631-48a8-99fd-d520b9221db1 tempest-SnapshotMetadataTestJSON-477171866 None] Lock "cinder-436babc8-99ea-43af-9095-63cb7a272f4a-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:37 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] GroupSnapshot b919a6b9-b6df-44c0-a247-30ee1f8c7711: creating. Feb 26 03:07:37 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Group snapshot b919a6b9-b6df-44c0-a247-30ee1f8c7711: creating. {{(pid=83121) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 26 03:07:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:37 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Creating offline snapshot 651c26aa-6d65-44c4-8a5b-f266634d5e48 of volume 17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:07:37 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6241fd0f-852e-4969-b95d-39a4b2fe7484]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:37 devstack sudo[85172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 Feb 26 03:07:37 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:37 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878" returned: 0 in 0.496s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:37 devstack sudo[85177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 1G Feb 26 03:07:37 devstack sudo[85177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:38 devstack sudo[85177]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 1G" returned: 0 in 0.518s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17474c0a-4352-46ee-b008-01ce25c6f878 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:38 devstack sudo[85182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17474c0a-4352-46ee-b008-01ce25c6f878 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 Feb 26 03:07:38 devstack sudo[85182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Flow 'volume_create_manager' (2ca4802d-25f3-4b95-aaca-e3eba4b2323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed2f784-5825-4dbf-8614-b9d04ac94231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed2f784-5825-4dbf-8614-b9d04ac94231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1661503870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa093d4e-ea12-470b-b868-367353b38691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d370aed0173140078f9eb4687e00b14a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:38Z,use_quota=True,user_id='6f080e8a5ded440184b5a1696710877b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f52b5f3-23e6-4f78-b0a3-d8b1a26f9d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f52b5f3-23e6-4f78-b0a3-d8b1a26f9d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab85672-0cab-4bf6-95fc-710ac8b06a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab85672-0cab-4bf6-95fc-710ac8b06a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa093d4e-ea12-470b-b868-367353b38691', 'volume_name': 'volume-aa093d4e-ea12-470b-b868-367353b38691', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e567df1-c015-46a8-9507-d48eb575f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e567df1-c015-46a8-9507-d48eb575f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5e760c-8aa9-4e4f-b0e2-e1fdda048a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:38 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Volume aa093d4e-ea12-470b-b868-367353b38691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa093d4e-ea12-470b-b868-367353b38691', 'volume_size': 1} Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:38 devstack sudo[85182]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17474c0a-4352-46ee-b008-01ce25c6f878 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48" returned: 0 in 0.437s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:38 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:07:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:38 devstack sudo[85187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 Feb 26 03:07:38 devstack sudo[85187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:39 devstack sudo[85187]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:39 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.info Feb 26 03:07:39 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:39 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.info" returned: 0 in 0.388s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:39 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.info is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:07:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:39 devstack sudo[85193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.info Feb 26 03:07:39 devstack sudo[85193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:40 devstack sudo[85193]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.info" returned: 0 in 0.420s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.721s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1661503870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa093d4e-ea12-470b-b868-367353b38691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d370aed0173140078f9eb4687e00b14a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:38Z,use_quota=True,user_id='6f080e8a5ded440184b5a1696710877b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Creating volume aa093d4e-ea12-470b-b868-367353b38691 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:07:40 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:40 devstack sudo[85196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691 1073741824 Feb 26 03:07:40 devstack sudo[85196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:40 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4bd65dc1-ed2c-42d8-95b4-68b79600c3d7 tempest-GroupSnapshotsTest-681902376 None] group_snapshot b919a6b9-b6df-44c0-a247-30ee1f8c7711: created successfully Feb 26 03:07:40 devstack sudo[85196]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691 1073741824" returned: 0 in 0.497s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:40 devstack sudo[85201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691 Feb 26 03:07:40 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:41 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691" returned: 0 in 0.408s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5e760c-8aa9-4e4f-b0e2-e1fdda048a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa093d4e-ea12-470b-b868-367353b38691', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cff232b-7419-4ef2-a26a-3a172bd92cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:41 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Volume volume-aa093d4e-ea12-470b-b868-367353b38691 (aa093d4e-ea12-470b-b868-367353b38691): created successfully Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cff232b-7419-4ef2-a26a-3a172bd92cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Flow 'volume_create_manager' (2ca4802d-25f3-4b95-aaca-e3eba4b2323f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:41 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5eb57151-4444-49e7-b287-1dc3a6949220 tempest-AbsoluteLimitsTests-587182665 None] Created volume successfully. Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-651c26aa-6d65-44c4-8a5b-f266634d5e48-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" by "_create_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-651c26aa-6d65-44c4-8a5b-f266634d5e48-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Creating volume 09b2762e-8e5f-4a1b-a8f9-01d410f1b162 from snapshot 651c26aa-6d65-44c4-8a5b-f266634d5e48 {{(pid=83121) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] snapshot: 651c26aa-6d65-44c4-8a5b-f266634d5e48, volume: 09b2762e-8e5f-4a1b-a8f9-01d410f1b162, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b48ee87-7f45-4484-9444-27f14b2e143a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:41 devstack sudo[85205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 Feb 26 03:07:41 devstack sudo[85205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Acquiring lock "cinder-aa093d4e-ea12-470b-b868-367353b38691-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Lock "cinder-aa093d4e-ea12-470b-b868-367353b38691-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Acquiring lock "cinder-quobyte-aa093d4e-ea12-470b-b868-367353b38691" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Lock "cinder-quobyte-aa093d4e-ea12-470b-b868-367353b38691" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5bcbda-4c78-4393-8587-196b9f196cf7]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:41 devstack sudo[85208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691 Feb 26 03:07:41 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:41 devstack sudo[85205]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48" returned: 0 in 0.466s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17474c0a-4352-46ee-b008-01ce25c6f878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fd787d-0f6f-4401-9bb4-36ec38e14ef9]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:42 devstack sudo[85212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 Feb 26 03:07:42 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:42 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691" returned: 0 in 0.477s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:42 devstack sudo[85217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691 Feb 26 03:07:42 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:42 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878" returned: 0 in 0.482s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:42 devstack sudo[85222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 Feb 26 03:07:42 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:42 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-aa093d4e-ea12-470b-b868-367353b38691" returned: 0 in 0.405s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Lock "cinder-quobyte-aa093d4e-ea12-470b-b868-367353b38691" released by "delete_volume" :: held 0.901s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Created reservations ['4d8bb455-e97d-4a93-a13d-f4a924839aa8', 'f1c66f53-b915-4a39-ade7-6ed0ce52bc36', '4981657f-1a8b-4c8e-b382-e54298ab6dbe', 'e94481eb-d556-41c1-86b2-bbe07134c173'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:42 devstack sudo[85229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:07:42 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:43 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 1.096s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:43 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:43 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Deleted volume successfully. Feb 26 03:07:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cfa23978-a9bc-4d81-ac17-5dc682ab624d tempest-AbsoluteLimitsTests-587182665 None] Lock "cinder-aa093d4e-ea12-470b-b868-367353b38691-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:45 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" returned: 0 in 2.720s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:45 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c975b5ea-f8c2-4613-b826-d5d0847e387b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:45 devstack sudo[85253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 Feb 26 03:07:45 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:45 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878" returned: 0 in 0.674s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:45 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878, size 1024.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:07:45 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Converted 1024.00 MB image at 376.38 MB/s Feb 26 03:07:45 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:07:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:45 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 Feb 26 03:07:45 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:46 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" returned: 0 in 0.475s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" released by "_copy_volume_from_snapshot" :: held 4.883s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-651c26aa-6d65-44c4-8a5b-f266634d5e48-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" released by "_create_volume_from_snapshot" :: held 4.902s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.912s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:46 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0e321062-055f-41b8-b8cd-ed07778ccddb tempest-GroupSnapshotsTest-681902376 None] Create group from source-snapshot-b919a6b9-b6df-44c0-a247-30ee1f8c7711 completed successfully. Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Flow 'volume_create_manager' (b3b45588-93f0-4da5-ab74-d323d068bf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4073457-1d46-485a-9d34-ff05af3f4295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4073457-1d46-485a-9d34-ff05af3f4295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-966390891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3227e13ae3a449438bd9297e0e2c79be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:46Z,use_quota=True,user_id='5fdd7e6a95074323ada7f156b30162d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfcad6f-1d00-4d92-bb99-6d1c4a5f299a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfcad6f-1d00-4d92-bb99-6d1c4a5f299a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913ea3fb-da97-4750-9ecb-965387fdcb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913ea3fb-da97-4750-9ecb-965387fdcb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f', 'volume_name': 'volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94358021-9e92-4c16-bae7-0d659386b6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94358021-9e92-4c16-bae7-0d659386b6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132c68fc-bfef-4255-8007-235a96ac43df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:46 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Volume 4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f', 'volume_size': 1} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-966390891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3227e13ae3a449438bd9297e0e2c79be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:46Z,use_quota=True,user_id='5fdd7e6a95074323ada7f156b30162d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Creating volume 4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:07:46 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:46 devstack sudo[85261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f 1073741824 Feb 26 03:07:46 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:46 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f 1073741824" returned: 0 in 0.468s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:47 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f Feb 26 03:07:47 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca7b4a8-2999-466f-ad94-f09f67bfd674]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:47 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f" returned: 0 in 0.456s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132c68fc-bfef-4255-8007-235a96ac43df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73068542-940e-4640-b623-fe1f1a182aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:47 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Volume volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f (4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f): created successfully Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73068542-940e-4640-b623-fe1f1a182aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Flow 'volume_create_manager' (b3b45588-93f0-4da5-ab74-d323d068bf49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:47 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f70e4ecb-c50e-438d-bfe3-c4c91c3aeaea tempest-VolumesMetadataTest-494793898 None] Created volume successfully. Feb 26 03:07:47 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 Feb 26 03:07:47 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:47 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" returned: 0 in 0.497s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:47 devstack sudo[85274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162 Feb 26 03:07:47 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:48 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" returned: 0 in 0.393s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-09b2762e-8e5f-4a1b-a8f9-01d410f1b162" released by "delete_volume" :: held 0.913s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['4a918927-8b13-4f94-a506-bbd90d2f762e'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:48 devstack cinder-volume[83121]: WARNING cinder.quota [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1979713921 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1979713921, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:07:48 devstack cinder-volume[83121]: WARNING cinder.quota [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1979713921 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1979713921, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['99609bbf-7b39-48f2-b03e-be9131dc6e9e', '70bea529-1b2b-4d20-a3de-ba0495597049', '0f215cc4-0bc2-4443-bfc9-199f75762ada', 'f5d0ba0d-986a-4222-84c0-585750483a50'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:48 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:07:48 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:48 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] group_snapshot b919a6b9-b6df-44c0-a247-30ee1f8c7711: deleting Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] group_snapshot b919a6b9-b6df-44c0-a247-30ee1f8c7711: deleting {{(pid=83121) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-17474c0a-4352-46ee-b008-01ce25c6f878" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-17474c0a-4352-46ee-b008-01ce25c6f878" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-651c26aa-6d65-44c4-8a5b-f266634d5e48" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-651c26aa-6d65-44c4-8a5b-f266634d5e48" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Deleting offline snapshot 651c26aa-6d65-44c4-8a5b-f266634d5e48 of volume 17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] snapshot_file for this snap is: volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d970735-32ca-4008-a0b7-72035795877b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:48 devstack sudo[85279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 Feb 26 03:07:48 devstack sudo[85279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:48 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.494s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:48 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:48 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5c3cc7a7-43f1-4883-8195-95fb336fe2e2 tempest-GroupSnapshotsTest-681902376 None] Delete group completed successfully. Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Acquiring lock "cinder-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Lock "cinder-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:49 devstack sudo[85279]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Acquiring lock "cinder-quobyte-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48" returned: 0 in 0.565s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17474c0a-4352-46ee-b008-01ce25c6f878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Lock "cinder-quobyte-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f" acquired by "delete_volume" :: waited 0.018s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c9bc4d-1b1d-4bce-9229-58e386a2919d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[47389474-39c1-4a23-a1ed-ce42a147120e]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:49 devstack sudo[85285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 Feb 26 03:07:49 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:49 devstack sudo[85286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f Feb 26 03:07:49 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:49 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878" returned: 0 in 0.452s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:49 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 Feb 26 03:07:49 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:49 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:49 devstack sudo[85297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f Feb 26 03:07:49 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:50 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f" returned: 0 in 0.408s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Lock "cinder-quobyte-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f" released by "delete_volume" :: held 0.916s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Created reservations ['118b3c6c-2d46-4c9d-83fc-2318680b2cc9', '7454b6e1-a645-4122-9d76-5a2f46f6255b', '0aae1fc4-aaa0-4484-ad56-0fefbb7fb3ca', 'd5e900da-7827-4ab5-8211-9e9775617b53'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:50 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48" returned: 0 in 0.511s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:50 devstack sudo[85303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48 Feb 26 03:07:50 devstack sudo[85303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:50 devstack sudo[85305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:07:50 devstack sudo[85305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:50 devstack sudo[85303]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878.651c26aa-6d65-44c4-8a5b-f266634d5e48" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-651c26aa-6d65-44c4-8a5b-f266634d5e48" released by "_delete_snapshot" :: held 2.076s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:50 devstack sudo[85305]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-17474c0a-4352-46ee-b008-01ce25c6f878" released by "delete_snapshot" :: held 2.086s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.465s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:50 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Deleted volume successfully. Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4751baad-1661-4d5a-805b-0b9f54aaf19d tempest-VolumesMetadataTest-494793898 None] Lock "cinder-4f90da60-003a-4e15-ad9e-7d0fb5ecfc5f-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:50 devstack cinder-volume[83121]: WARNING cinder.quota [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1979713921 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1979713921, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:07:50 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['8f1fd90d-b4f6-4aa4-b7ee-7d47138ec596', '92b520c7-347d-4edd-b266-cbc8f13b343a', '358cc7c0-8e2a-4d4d-8d59-f95b2af979f0', 'f793349a-13eb-4f1f-a786-9377f5dbcb31'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:50 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-92822ec7-d5cc-4993-a201-09f3e1ee1330 tempest-GroupSnapshotsTest-681902376 None] group_snapshot b919a6b9-b6df-44c0-a247-30ee1f8c7711: deleted successfully Feb 26 03:07:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-17474c0a-4352-46ee-b008-01ce25c6f878" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-17474c0a-4352-46ee-b008-01ce25c6f878" acquired by "delete_volume" :: waited 0.023s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:51 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9539551-0f11-449c-a016-b7ee849deb37]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Flow 'volume_create_manager' (e5c3dbb9-366f-4f49-ae1e-54893d3346f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0af836-4a3d-4695-a2c7-2830e023e053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0af836-4a3d-4695-a2c7-2830e023e053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-715536823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b5aed8-c5b7-4f9c-bb56-5e084750fb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df3569793cc4479983c7ad50857e955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:52Z,use_quota=True,user_id='8d8a63a985114663b8259b028790c1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbcfe05-19ec-45ee-be0d-337913123ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbcfe05-19ec-45ee-be0d-337913123ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d17f6ae-caf6-4d85-adf6-8b258ea1075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d17f6ae-caf6-4d85-adf6-8b258ea1075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b5aed8-c5b7-4f9c-bb56-5e084750fb5e', 'volume_name': 'volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1b82c8-f559-4210-83d5-d6a76d9c77fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1b82c8-f559-4210-83d5-d6a76d9c77fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b528450-4fe7-4ce3-aeab-770708822e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:52 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 Feb 26 03:07:52 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:52 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Volume 72b5aed8-c5b7-4f9c-bb56-5e084750fb5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e', 'volume_size': 1} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-715536823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b5aed8-c5b7-4f9c-bb56-5e084750fb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df3569793cc4479983c7ad50857e955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:52Z,use_quota=True,user_id='8d8a63a985114663b8259b028790c1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Creating volume 72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:07:52 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:52 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e 1073741824 Feb 26 03:07:52 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:52 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878" returned: 0 in 0.504s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:52 devstack sudo[85320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878 Feb 26 03:07:52 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:52 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e 1073741824" returned: 0 in 0.544s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:52 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e Feb 26 03:07:52 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:52 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-17474c0a-4352-46ee-b008-01ce25c6f878" returned: 0 in 0.413s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-17474c0a-4352-46ee-b008-01ce25c6f878" released by "delete_volume" :: held 0.959s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:07:52 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Created reservations ['94afd094-c0de-41da-a9a1-74f376a140f1'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:53 devstack cinder-volume[83121]: WARNING cinder.db.sqlalchemy.api [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1979713921'] Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Created reservations ['5d8042ae-cb11-4aa9-87d5-b2adff7eefe9', '39ac5d0e-45e7-464d-a357-42b6d5b7fef6', '9a31644d-5dcf-484d-9ca3-be9ef5e89ccc', '8eadb741-823a-46a6-8be7-1e7f17e68b6f'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:53 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e" returned: 0 in 0.460s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:53 devstack sudo[85326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:07:53 devstack sudo[85326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b528450-4fe7-4ce3-aeab-770708822e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9ec52f-0640-4e78-858d-80fe6e6474c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:53 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Volume volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e (72b5aed8-c5b7-4f9c-bb56-5e084750fb5e): created successfully Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9ec52f-0640-4e78-858d-80fe6e6474c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Flow 'volume_create_manager' (e5c3dbb9-366f-4f49-ae1e-54893d3346f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:53 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0342bd7a-91dc-4a79-a16a-1c1e603dcedf tempest-VolumesCloneTest-771820940 None] Created volume successfully. Feb 26 03:07:53 devstack sudo[85326]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:53 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:07:53 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8650c7b3-c8b0-4ef8-93fa-c0c19b3ffb5f tempest-GroupSnapshotsTest-681902376 None] Delete group completed successfully. Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Flow 'volume_create_manager' (35e35020-8b0a-4e4a-b6e3-113af3ec3923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618ad565-720a-4c54-9f0c-d87c8431a0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618ad565-720a-4c54-9f0c-d87c8431a0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-72846474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39faf7e-2a50-40a3-84d2-f1c0c0926a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df3569793cc4479983c7ad50857e955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=72b5aed8-c5b7-4f9c-bb56-5e084750fb5e,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:54Z,use_quota=True,user_id='8d8a63a985114663b8259b028790c1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf846fa-01a9-4527-8786-42f46af51292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf846fa-01a9-4527-8786-42f46af51292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a85b7a4-47b2-4ce0-87f6-948e842abace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a85b7a4-47b2-4ce0-87f6-948e842abace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f39faf7e-2a50-40a3-84d2-f1c0c0926a5b', 'volume_name': 'volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b', 'volume_size': 2, 'source_volid': '72b5aed8-c5b7-4f9c-bb56-5e084750fb5e', 'source_volstatus': 'available'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffec9db-7b96-4a9d-8bdc-293393161a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffec9db-7b96-4a9d-8bdc-293393161a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b70aed2-dbcc-4aa8-a828-768f649bbfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:54 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Volume f39faf7e-2a50-40a3-84d2-f1c0c0926a5b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b', 'volume_size': 2, 'source_volid': '72b5aed8-c5b7-4f9c-bb56-5e084750fb5e', 'source_volstatus': 'available'} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:54 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Cloning volume 72b5aed8-c5b7-4f9c-bb56-5e084750fb5e to volume f39faf7e-2a50-40a3-84d2-f1c0c0926a5b Feb 26 03:07:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-431c075c-8ee3-471e-b4d9-692c8aa2cf08 tempest-GroupSnapshotsTest-681902376 None] Group tempest-GroupSnapshotsTest-Group-973968381: creating Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Creating offline snapshot 7ba33d74-ee1f-4852-89dd-0b409b1e9541 of volume 72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[18130d77-2adb-4264-a53f-5c3b179ed64c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-431c075c-8ee3-471e-b4d9-692c8aa2cf08 tempest-GroupSnapshotsTest-681902376 None] Group tempest-GroupSnapshotsTest-Group-973968381: created successfully Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-431c075c-8ee3-471e-b4d9-692c8aa2cf08 tempest-GroupSnapshotsTest-681902376 None] Create group completed successfully. Feb 26 03:07:54 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e Feb 26 03:07:54 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:54 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e" returned: 0 in 0.484s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:54 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 1G Feb 26 03:07:54 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:55 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 1G" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:55 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 Feb 26 03:07:55 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Flow 'volume_create_manager' (8f67b33e-39f9-4f6f-8436-f1db18b13b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c375de5d-fa57-4bcb-b835-20b40ac80a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c375de5d-fa57-4bcb-b835-20b40ac80a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1095643074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36c8dab2-0d4f-41b4-a3d9-04dbbd86fcf8,host='devstack@QuobyteHD#QuobyteHD',id=f13d34d4-9bd5-43c0-b054-0993bb6b2bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c911722a4c4f35934b05c9a2b91bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:56Z,use_quota=True,user_id='ffd3dc0ab6cc47588ae8ac57768ff25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ab880f6-468b-4e3e-8ee1-be35be58551c),volume_type_id=4ab880f6-468b-4e3e-8ee1-be35be58551c)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67762791-bbe3-4424-a358-238378cac141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67762791-bbe3-4424-a358-238378cac141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f269503-2f85-4391-bfc7-c6a87b811c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f269503-2f85-4391-bfc7-c6a87b811c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13d34d4-9bd5-43c0-b054-0993bb6b2bb2', 'volume_name': 'volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d97e9fb-9256-4063-967a-eda0ec7c01b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d97e9fb-9256-4063-967a-eda0ec7c01b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34f8478-883e-433c-b677-e4893c7c5288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:07:55 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Volume f13d34d4-9bd5-43c0-b054-0993bb6b2bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2', 'volume_size': 1} Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:55 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541" returned: 0 in 0.497s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:55 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 is being set with open permissions: ugo+rw Feb 26 03:07:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:55 devstack sudo[85345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 Feb 26 03:07:55 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:56 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541" returned: 0 in 0.414s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:56 devstack sudo[85359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.info Feb 26 03:07:56 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:56 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.info" returned: 0 in 0.421s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:56 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.info is being set with open permissions: ugo+rw Feb 26 03:07:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:56 devstack sudo[85363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.info Feb 26 03:07:56 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:57 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.info" returned: 0 in 0.412s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Acquiring lock "cinder-quobyte-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Lock "cinder-quobyte-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] snapshot: 7ba33d74-ee1f-4852-89dd-0b409b1e9541, volume: f39faf7e-2a50-40a3-84d2-f1c0c0926a5b, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[750a14ec-9175-4dad-9601-b06689d0df49]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:57 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 Feb 26 03:07:57 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:57 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541" returned: 0 in 0.441s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bfd01b-2b9d-49d5-93a9-861382223d8e]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:07:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:57 devstack sudo[85371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e Feb 26 03:07:57 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:07:58 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root Feb 26 03:07:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e" returned: 0 in 0.501s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:07:58 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:07:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:07:58 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b Feb 26 03:07:58 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:00 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b" returned: 0 in 2.087s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:00 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d731fafd-12af-455b-a37d-486c1bd6a94d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:00 devstack sudo[85389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e Feb 26 03:08:00 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:00 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e" returned: 0 in 0.585s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:00 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:08:00 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Converted 1024.00 MB image at 490.43 MB/s Feb 26 03:08:00 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b is being set with open permissions: ugo+rw Feb 26 03:08:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:00 devstack sudo[85394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b Feb 26 03:08:00 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:01 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b" returned: 0 in 0.406s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Lock "cinder-quobyte-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b" released by "_copy_volume_from_snapshot" :: held 4.065s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Acquiring lock "cinder-quobyte-7ba33d74-ee1f-4852-89dd-0b409b1e9541" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Lock "cinder-quobyte-7ba33d74-ee1f-4852-89dd-0b409b1e9541" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Deleting offline snapshot 7ba33d74-ee1f-4852-89dd-0b409b1e9541 of volume 72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] snapshot_file for this snap is: volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fd060c-bf9e-4420-bfb3-68440fdef7b3]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:01 devstack sudo[85398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 Feb 26 03:08:01 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:01 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541" returned: 0 in 0.453s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d3cbcc-6674-4f1e-ab3d-104a6d21dc8b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:01 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e Feb 26 03:08:01 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:02 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e" returned: 0 in 0.486s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:02 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 Feb 26 03:08:02 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:02 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541" returned: 0 in 0.456s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:02 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541 Feb 26 03:08:02 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:03 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e.7ba33d74-ee1f-4852-89dd-0b409b1e9541" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Lock "cinder-quobyte-7ba33d74-ee1f-4852-89dd-0b409b1e9541" released by "_delete_snapshot" :: held 1.827s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.727s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.290s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36c8dab2-0d4f-41b4-a3d9-04dbbd86fcf8,created_at=2026-02-26T02:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1095643074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36c8dab2-0d4f-41b4-a3d9-04dbbd86fcf8,host='devstack@QuobyteHD#QuobyteHD',id=f13d34d4-9bd5-43c0-b054-0993bb6b2bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c911722a4c4f35934b05c9a2b91bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:07:56Z,use_quota=True,user_id='ffd3dc0ab6cc47588ae8ac57768ff25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ab880f6-468b-4e3e-8ee1-be35be58551c),volume_type_id=4ab880f6-468b-4e3e-8ee1-be35be58551c)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Creating volume f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:03 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b70aed2-dbcc-4aa8-a828-768f649bbfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b', 'volume_size': 2, 'source_volid': '72b5aed8-c5b7-4f9c-bb56-5e084750fb5e', 'source_volstatus': 'available'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13299d8a-5e90-4f40-bdda-3ec134223168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:03 devstack sudo[85416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 1073741824 Feb 26 03:08:03 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:03 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Volume volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b (f39faf7e-2a50-40a3-84d2-f1c0c0926a5b): created successfully Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13299d8a-5e90-4f40-bdda-3ec134223168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Flow 'volume_create_manager' (35e35020-8b0a-4e4a-b6e3-113af3ec3923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:03 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4275e30d-c963-4beb-b772-a9363a91d254 tempest-VolumesCloneTest-771820940 None] Created volume successfully. Feb 26 03:08:03 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 1073741824" returned: 0 in 0.497s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:03 devstack sudo[85421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 Feb 26 03:08:03 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Acquiring lock "cinder-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Lock "cinder-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Acquiring lock "cinder-quobyte-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Lock "cinder-quobyte-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b" acquired by "delete_volume" :: waited 0.017s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e273c9-dadb-4896-a415-69058d505730]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:04 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b Feb 26 03:08:04 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:04 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" returned: 0 in 0.430s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34f8478-883e-433c-b677-e4893c7c5288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291c50b2-384a-4b35-9c7d-d7157e1b54a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:04 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Volume volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 (f13d34d4-9bd5-43c0-b054-0993bb6b2bb2): created successfully Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291c50b2-384a-4b35-9c7d-d7157e1b54a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Flow 'volume_create_manager' (8f67b33e-39f9-4f6f-8436-f1db18b13b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:04 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-ac38d8f1-cbf5-4952-bce3-e63c1b5108f6 tempest-GroupSnapshotsTest-681902376 None] Created volume successfully. Feb 26 03:08:04 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b" returned: 0 in 0.494s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:04 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b Feb 26 03:08:04 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Flow 'volume_create_manager' (e050ce06-f673-4599-8323-03ab5ac1d922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5d9a11-b194-4c13-a1d7-1ac44ffcf838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5d9a11-b194-4c13-a1d7-1ac44ffcf838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-607169161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36c8dab2-0d4f-41b4-a3d9-04dbbd86fcf8,host='devstack@QuobyteHD#QuobyteHD',id=6e937fe8-1aed-484e-9ceb-51248bc888b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c911722a4c4f35934b05c9a2b91bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:05Z,use_quota=True,user_id='ffd3dc0ab6cc47588ae8ac57768ff25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ab880f6-468b-4e3e-8ee1-be35be58551c),volume_type_id=4ab880f6-468b-4e3e-8ee1-be35be58551c)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d073d8-5be5-44f7-96a7-513bbaa4d5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d073d8-5be5-44f7-96a7-513bbaa4d5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae91330-baf8-443d-9a2b-5b916cd2aac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae91330-baf8-443d-9a2b-5b916cd2aac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e937fe8-1aed-484e-9ceb-51248bc888b5', 'volume_name': 'volume-6e937fe8-1aed-484e-9ceb-51248bc888b5', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68ba184-e1b8-4da5-8276-35c5b1bcf259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68ba184-e1b8-4da5-8276-35c5b1bcf259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199c6f23-4821-47f4-9640-858bde2aae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:04 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Volume 6e937fe8-1aed-484e-9ceb-51248bc888b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e937fe8-1aed-484e-9ceb-51248bc888b5', 'volume_size': 1} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36c8dab2-0d4f-41b4-a3d9-04dbbd86fcf8,created_at=2026-02-26T02:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-607169161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36c8dab2-0d4f-41b4-a3d9-04dbbd86fcf8,host='devstack@QuobyteHD#QuobyteHD',id=6e937fe8-1aed-484e-9ceb-51248bc888b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c911722a4c4f35934b05c9a2b91bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:05Z,use_quota=True,user_id='ffd3dc0ab6cc47588ae8ac57768ff25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ab880f6-468b-4e3e-8ee1-be35be58551c),volume_type_id=4ab880f6-468b-4e3e-8ee1-be35be58551c)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Creating volume 6e937fe8-1aed-484e-9ceb-51248bc888b5 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:04 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:04 devstack sudo[85431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 1073741824 Feb 26 03:08:04 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:04 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Lock "cinder-quobyte-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b" released by "delete_volume" :: held 0.966s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=120,cinder:UPDATE=132,cinder:DELETE=9,cinder:INSERT=34 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:08:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=130,cinder:SELECT=105,cinder:INSERT=30,cinder:DELETE=10 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Created reservations ['b52286d5-ebe3-4119-a9a8-e3ec4353c0e5', 'a3fd7e98-a852-4fc7-911e-c12151b0c058', '5d707b45-4238-4636-a7e4-f98123167908', '7be18f00-cdf5-4cfd-8541-10e207ad6589'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:05 devstack sudo[85434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:05 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:05 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 1073741824" returned: 0 in 0.461s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:05 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 Feb 26 03:08:05 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:05 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.402s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:05 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Deleted volume successfully. Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-38325472-831d-4730-8cb6-62abc23bba73 tempest-VolumesCloneTest-771820940 None] Lock "cinder-f39faf7e-2a50-40a3-84d2-f1c0c0926a5b-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:05 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5" returned: 0 in 0.443s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199c6f23-4821-47f4-9640-858bde2aae92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e937fe8-1aed-484e-9ceb-51248bc888b5', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db58ddd-8969-4ea4-89c8-c51eb94d17a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:05 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Volume volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 (6e937fe8-1aed-484e-9ceb-51248bc888b5): created successfully Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db58ddd-8969-4ea4-89c8-c51eb94d17a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Flow 'volume_create_manager' (e050ce06-f673-4599-8323-03ab5ac1d922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:05 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-98cdc355-c481-466d-b763-a12ee8f188a9 tempest-GroupSnapshotsTest-681902376 None] Created volume successfully. Feb 26 03:08:05 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-fc85964c-6b67-4776-8aa8-a094632f3a44 tempest-GroupSnapshotsTest-681902376 None] Update group completed successfully. Feb 26 03:08:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Acquiring lock "cinder-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Lock "cinder-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Acquiring lock "cinder-quobyte-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Lock "cinder-quobyte-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:06 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9fe52f-d2ac-419f-b152-c9d30e163f57]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:06 devstack sudo[85443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e Feb 26 03:08:06 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:06 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e" returned: 0 in 0.471s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:06 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e Feb 26 03:08:06 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:07 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-ff2b09ea-db66-4bf1-afcc-b36e31b2d43a tempest-GroupSnapshotsTest-681902376 None] Update group completed successfully. Feb 26 03:08:07 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Lock "cinder-quobyte-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e" released by "delete_volume" :: held 0.979s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Created reservations ['75e1e8f3-bcd3-4a61-bf51-772018af0e90', '7ddca25d-994d-4042-9ed4-cf4f19f5a0ba', '1d9ed454-d97a-4f0e-a88b-c9d20e25ce8a', '984f8d58-eae9-4add-abfe-38b1be544dbb'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:07 devstack sudo[85485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:07 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:07 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.418s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:07 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Deleted volume successfully. Feb 26 03:08:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71223665-2c3e-429f-b303-161b500f1a14 tempest-VolumesCloneTest-771820940 None] Lock "cinder-72b5aed8-c5b7-4f9c-bb56-5e084750fb5e-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:08 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-909785a0-a5d1-4f5a-81b2-70e32f5ca377 tempest-GroupSnapshotsTest-681902376 None] Update group completed successfully. Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (ba65cc92-c03e-430a-ba8c-a3ae9d6a3a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c5d8b1-7d2d-492e-a883-d6545e33b49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c5d8b1-7d2d-492e-a883-d6545e33b49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1088971866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03fa989-6c27-4a7b-ad81-331c8ed2776b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:09Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e653031-240b-4c87-bcc3-3d67ff152df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e653031-240b-4c87-bcc3-3d67ff152df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b170da5-8ab3-4b59-8042-6ab5978d5b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b170da5-8ab3-4b59-8042-6ab5978d5b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03fa989-6c27-4a7b-ad81-331c8ed2776b', 'volume_name': 'volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a130fd-a31c-4da9-906f-6268c2715435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a130fd-a31c-4da9-906f-6268c2715435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12567f79-e98a-45f0-a230-e53d07f4ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:08 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume e03fa989-6c27-4a7b-ad81-331c8ed2776b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b', 'volume_size': 1} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1088971866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03fa989-6c27-4a7b-ad81-331c8ed2776b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:09Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Creating volume e03fa989-6c27-4a7b-ad81-331c8ed2776b {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:08 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:08 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b 1073741824 Feb 26 03:08:08 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:09 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-ac45d810-1baa-4491-b3d3-fc7b5d8a9053 tempest-GroupSnapshotsTest-681902376 None] Update group completed successfully. Feb 26 03:08:09 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b 1073741824" returned: 0 in 0.519s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:09 devstack sudo[85500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b Feb 26 03:08:09 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:09 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b" returned: 0 in 0.402s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12567f79-e98a-45f0-a230-e53d07f4ce97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c612a3-571d-4e93-b201-bdc59e0e5d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:09 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b (e03fa989-6c27-4a7b-ad81-331c8ed2776b): created successfully Feb 26 03:08:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c612a3-571d-4e93-b201-bdc59e0e5d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (ba65cc92-c03e-430a-ba8c-a3ae9d6a3a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:09 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8718b65d-c748-45fa-b38d-d5650ebd3dc2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created volume successfully. Feb 26 03:08:10 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] GroupSnapshot 8d980087-4004-41ee-b036-35db40760b1f: creating. Feb 26 03:08:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Group snapshot 8d980087-4004-41ee-b036-35db40760b1f: creating. {{(pid=83121) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 26 03:08:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Creating offline snapshot 847a7381-d494-4463-9681-6e91bc71a57e of volume 6e937fe8-1aed-484e-9ceb-51248bc888b5 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:08:10 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2f6b32-cb45-45fe-bb33-f20b49a04c05]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:10 devstack sudo[85503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 Feb 26 03:08:10 devstack sudo[85503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:11 devstack sudo[85503]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5" returned: 0 in 0.489s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:11 devstack sudo[85509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e 1G Feb 26 03:08:11 devstack sudo[85509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:11 devstack sudo[85509]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e 1G" returned: 0 in 0.499s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:11 devstack sudo[85514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e Feb 26 03:08:11 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:12 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e" returned: 0 in 0.426s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:12 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:08:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:12 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e Feb 26 03:08:12 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:12 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e" returned: 0 in 0.403s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:12 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.info Feb 26 03:08:12 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:12 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.info" returned: 0 in 0.421s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:12 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.info is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:08:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:12 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.info Feb 26 03:08:12 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:13 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.info" returned: 0 in 0.408s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Creating offline snapshot 9532421d-aaaa-4bdd-a0fa-078e7df7ddef of volume f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:08:13 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5282306b-56b2-45ed-a975-878c1208f64d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:13 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 Feb 26 03:08:13 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:13 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" returned: 0 in 0.488s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:13 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef 1G Feb 26 03:08:13 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:14 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef 1G" returned: 0 in 0.482s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:14 devstack sudo[85538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef Feb 26 03:08:14 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:14 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef" returned: 0 in 0.420s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:14 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:08:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:14 devstack sudo[85543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef Feb 26 03:08:14 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:15 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef" returned: 0 in 0.417s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:15 devstack sudo[85546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.info Feb 26 03:08:15 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:15 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.info" returned: 0 in 0.397s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:15 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.info is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:08:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:15 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.info Feb 26 03:08:15 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:15 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.info" returned: 0 in 0.379s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.857s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Creating offline snapshot 1dc64e1c-6621-4940-8a59-f42d14538f12 of volume e03fa989-6c27-4a7b-ad81-331c8ed2776b {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:08:15 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c914c6c-db40-4244-aa6a-fdf48991abbd]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:16 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f3a036ea-09c1-49b3-86f5-438571af59bf tempest-GroupSnapshotsTest-681902376 None] group_snapshot 8d980087-4004-41ee-b036-35db40760b1f: created successfully Feb 26 03:08:16 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b Feb 26 03:08:16 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:16 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b" returned: 0 in 0.490s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:16 devstack sudo[85557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 1G Feb 26 03:08:16 devstack sudo[85557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:16 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] group_snapshot 8d980087-4004-41ee-b036-35db40760b1f: deleting Feb 26 03:08:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] group_snapshot 8d980087-4004-41ee-b036-35db40760b1f: deleting {{(pid=83121) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 26 03:08:16 devstack sudo[85557]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 1G" returned: 0 in 0.475s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:16 devstack sudo[85562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 Feb 26 03:08:16 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-6e937fe8-1aed-484e-9ceb-51248bc888b5" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-6e937fe8-1aed-484e-9ceb-51248bc888b5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-847a7381-d494-4463-9681-6e91bc71a57e" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-847a7381-d494-4463-9681-6e91bc71a57e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Deleting offline snapshot 847a7381-d494-4463-9681-6e91bc71a57e of volume 6e937fe8-1aed-484e-9ceb-51248bc888b5 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] snapshot_file for this snap is: volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7451171d-884e-4771-92c3-d2be6711641d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:17 devstack sudo[85564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e Feb 26 03:08:17 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:17 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12" returned: 0 in 0.440s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:17 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 is being set with open permissions: ugo+rw Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:17 devstack sudo[85569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 Feb 26 03:08:17 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:17 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e" returned: 0 in 0.493s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e937fe8-1aed-484e-9ceb-51248bc888b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8508ae95-e8d8-4e1f-b316-9b71389ef6ed]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:17 devstack sudo[85574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 Feb 26 03:08:17 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:17 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12" returned: 0 in 0.454s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:17 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.info Feb 26 03:08:17 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:18 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5" returned: 0 in 0.474s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:18 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e Feb 26 03:08:18 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:18 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.info" returned: 0 in 0.403s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:18 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.info is being set with open permissions: ugo+rw Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:18 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.info Feb 26 03:08:18 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:18 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e" returned: 0 in 0.431s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:18 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e Feb 26 03:08:18 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:18 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.info" returned: 0 in 0.403s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:18 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-988e4209-20ff-4d8d-b056-758e1bb556db tempest-CreateVolumesFromSnapshotTest-1571201336 None] Create snapshot completed successfully Feb 26 03:08:18 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5.847a7381-d494-4463-9681-6e91bc71a57e" returned: 0 in 0.459s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-847a7381-d494-4463-9681-6e91bc71a57e" released by "_delete_snapshot" :: held 1.923s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-6e937fe8-1aed-484e-9ceb-51248bc888b5" released by "delete_snapshot" :: held 1.932s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" acquired by "delete_snapshot" :: waited 0.005s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-9532421d-aaaa-4bdd-a0fa-078e7df7ddef" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-9532421d-aaaa-4bdd-a0fa-078e7df7ddef" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Deleting offline snapshot 9532421d-aaaa-4bdd-a0fa-078e7df7ddef of volume f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] snapshot_file for this snap is: volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0489d7ed-da5f-4d7d-878d-9f6683484662]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:19 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef Feb 26 03:08:19 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:19 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef" returned: 0 in 0.451s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3604a1-1fc2-42ef-b944-0cba26e2ea41]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:19 devstack sudo[85599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 Feb 26 03:08:19 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (99ce51e1-87c7-447d-bb73-f641e972cfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150b6dcc-5243-4ee9-89d0-6fd2a0b8b2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150b6dcc-5243-4ee9-89d0-6fd2a0b8b2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1138882617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:20Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a23246-56bd-49fc-b8bb-8d9885129dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a23246-56bd-49fc-b8bb-8d9885129dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15314029-9ec5-43f3-bd75-0d001ce304ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15314029-9ec5-43f3-bd75-0d001ce304ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c', 'volume_name': 'volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d79713e-c2f7-4cd0-97d8-78f59974dc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d79713e-c2f7-4cd0-97d8-78f59974dc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af439657-112f-43bc-8792-162e1e4a3566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:19 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c', 'volume_size': 1} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1138882617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:20Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Creating volume a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:19 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:19 devstack sudo[85601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c 1073741824 Feb 26 03:08:19 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (cb070556-53e9-4791-aada-d6cdfb4fce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d749e5d0-1850-426f-8b1c-cae739fb9cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d749e5d0-1850-426f-8b1c-cae739fb9cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212339292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6977f379-0b4c-45f0-b209-22b3afa45d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:20Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9875a3a5-e735-4c07-a7ea-a43cc550282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9875a3a5-e735-4c07-a7ea-a43cc550282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4e4494-e6be-4e67-a332-38f4085c4e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4e4494-e6be-4e67-a332-38f4085c4e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6977f379-0b4c-45f0-b209-22b3afa45d77', 'volume_name': 'volume-6977f379-0b4c-45f0-b209-22b3afa45d77', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7314227-6cf5-45a6-b4d3-145947078e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7314227-6cf5-45a6-b4d3-145947078e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df900dab-74ef-436e-b1d3-4a16eccbbfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:19 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume 6977f379-0b4c-45f0-b209-22b3afa45d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6977f379-0b4c-45f0-b209-22b3afa45d77', 'volume_size': 1} Feb 26 03:08:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (cb413caa-bb1e-45b3-83fe-1c7522cd138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d98605f-b920-4d84-bfa1-f2a7edb81685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d98605f-b920-4d84-bfa1-f2a7edb81685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1855158248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042a509a-02d6-4bfe-a916-bf790befe1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:20Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb57b09-c102-4ef2-bf1a-5a387b7c82b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb57b09-c102-4ef2-bf1a-5a387b7c82b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cffbb05-6c91-416a-ae62-afd1d1474a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cffbb05-6c91-416a-ae62-afd1d1474a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042a509a-02d6-4bfe-a916-bf790befe1ea', 'volume_name': 'volume-042a509a-02d6-4bfe-a916-bf790befe1ea', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b57ede-21a8-48d7-af5b-f5f29982b1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b57ede-21a8-48d7-af5b-f5f29982b1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bddad8f-1504-43f8-898d-937f629d8d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume 042a509a-02d6-4bfe-a916-bf790befe1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042a509a-02d6-4bfe-a916-bf790befe1ea', 'volume_size': 1} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" returned: 0 in 0.651s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:20 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef Feb 26 03:08:20 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (c561d08c-d301-4797-8940-a2865d2365ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e451b0e7-d1f6-4b9a-abb6-544edb735655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e451b0e7-d1f6-4b9a-abb6-544edb735655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659883746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62b8ce1-9396-403c-bcf4-541f638d996c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:20Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b921c598-f23b-4b24-aee4-59f423b53024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b921c598-f23b-4b24-aee4-59f423b53024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1cac8c-2727-4a55-bc84-6d9da1c37d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1cac8c-2727-4a55-bc84-6d9da1c37d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62b8ce1-9396-403c-bcf4-541f638d996c', 'volume_name': 'volume-d62b8ce1-9396-403c-bcf4-541f638d996c', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c179042-c1ee-426d-8ac4-21bd2206346b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c179042-c1ee-426d-8ac4-21bd2206346b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6058f4e3-ffa3-457c-b09e-58c2a37c918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume d62b8ce1-9396-403c-bcf4-541f638d996c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62b8ce1-9396-403c-bcf4-541f638d996c', 'volume_size': 1} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:20 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c 1073741824" returned: 0 in 0.694s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:20 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c Feb 26 03:08:20 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (7878add9-cf58-42d8-a280-e73e5497752d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbfae85-7d06-4592-aa20-248b592da964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbfae85-7d06-4592-aa20-248b592da964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-578395462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12eb1289-6236-46ee-9559-6e7c3e9eedf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:20Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a7cafe-cb46-4534-b6bb-801dab5063fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a7cafe-cb46-4534-b6bb-801dab5063fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0304746c-b8c8-4076-a8b5-8e695529526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0304746c-b8c8-4076-a8b5-8e695529526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12eb1289-6236-46ee-9559-6e7c3e9eedf5', 'volume_name': 'volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d665a99b-168a-440b-ae4c-874f8dfa5ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d665a99b-168a-440b-ae4c-874f8dfa5ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda1650d-c916-4e5f-939a-a37792d4e22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume 12eb1289-6236-46ee-9559-6e7c3e9eedf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5', 'volume_size': 1} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:20 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef" returned: 0 in 0.495s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:20 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef Feb 26 03:08:20 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:20 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212339292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6977f379-0b4c-45f0-b209-22b3afa45d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:20Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Creating volume 6977f379-0b4c-45f0-b209-22b3afa45d77 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:20 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:20 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77 1073741824 Feb 26 03:08:20 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af439657-112f-43bc-8792-162e1e4a3566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16ba4fe-db06-46ac-b05c-bb1345933928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:20 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c (a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c): created successfully Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16ba4fe-db06-46ac-b05c-bb1345933928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (99ce51e1-87c7-447d-bb73-f641e972cfe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:20 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e546f172-c983-4d3c-a0bf-204f5e438cb2 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created volume successfully. Feb 26 03:08:21 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2.9532421d-aaaa-4bdd-a0fa-078e7df7ddef" returned: 0 in 0.417s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-9532421d-aaaa-4bdd-a0fa-078e7df7ddef" released by "_delete_snapshot" :: held 2.057s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" released by "delete_snapshot" :: held 2.069s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:21 devstack cinder-volume[83121]: WARNING cinder.quota [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1170811173 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1170811173, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:08:21 devstack cinder-volume[83121]: WARNING cinder.quota [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1170811173 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1170811173, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['d66c795b-7163-48ab-b69d-2f9bf7a1c2ca', '2dbc2070-58d0-4633-8504-2e98205b0db7', 'c80aeec8-c783-4650-b5e7-98def0e97ef9', '35e32fce-e053-4fd8-bd24-f3e951019983'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['645697e3-1780-41d6-8918-9dc9547f26c8', 'cf28aff4-25fe-40fa-8ec9-030ba6c82ff8', '9c86d058-1c81-48c8-844c-d859962b1e7d', 'a77d587d-a53e-4ba9-ad8c-2191fd27ec2b'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:21 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3cce3ff1-62ae-4049-ba21-e266b40b3f62 tempest-GroupSnapshotsTest-681902376 None] group_snapshot 8d980087-4004-41ee-b036-35db40760b1f: deleted successfully Feb 26 03:08:21 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77 1073741824" returned: 0 in 0.594s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:21 devstack sudo[85626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77 Feb 26 03:08:21 devstack sudo[85626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-6e937fe8-1aed-484e-9ceb-51248bc888b5" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-6e937fe8-1aed-484e-9ceb-51248bc888b5" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4b4018-ad29-4d7b-8c2a-cfeb8a12b0aa]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:21 devstack sudo[85628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 Feb 26 03:08:21 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:21 devstack sudo[85626]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77" returned: 0 in 0.393s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1855158248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042a509a-02d6-4bfe-a916-bf790befe1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:20Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Creating volume 042a509a-02d6-4bfe-a916-bf790befe1ea {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:21 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df900dab-74ef-436e-b1d3-4a16eccbbfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6977f379-0b4c-45f0-b209-22b3afa45d77', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe26d6c-40cb-4180-b99b-cd4d04ad19f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:21 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea 1073741824 Feb 26 03:08:21 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:21 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume volume-6977f379-0b4c-45f0-b209-22b3afa45d77 (6977f379-0b4c-45f0-b209-22b3afa45d77): created successfully Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe26d6c-40cb-4180-b99b-cd4d04ad19f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (cb070556-53e9-4791-aada-d6cdfb4fce30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:21 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0804ea4f-bce4-4369-a117-75abdd910ea3 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created volume successfully. Feb 26 03:08:22 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5" returned: 0 in 0.485s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:22 devstack sudo[85636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5 Feb 26 03:08:22 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:22 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea 1073741824" returned: 0 in 0.477s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:22 devstack sudo[85641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea Feb 26 03:08:22 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:22 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6e937fe8-1aed-484e-9ceb-51248bc888b5" returned: 0 in 0.430s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-6e937fe8-1aed-484e-9ceb-51248bc888b5" released by "delete_volume" :: held 0.956s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba0c9d8-46cd-43d6-af30-cb085dd5b3bc]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:22 devstack sudo[85644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 Feb 26 03:08:22 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:22 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea" returned: 0 in 0.464s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.500s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659883746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62b8ce1-9396-403c-bcf4-541f638d996c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:20Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Creating volume d62b8ce1-9396-403c-bcf4-541f638d996c {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:22 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:22 devstack sudo[85647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c 1073741824 Feb 26 03:08:22 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bddad8f-1504-43f8-898d-937f629d8d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042a509a-02d6-4bfe-a916-bf790befe1ea', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577cc4cc-b27c-422c-a6e0-8004e2616e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:22 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume volume-042a509a-02d6-4bfe-a916-bf790befe1ea (042a509a-02d6-4bfe-a916-bf790befe1ea): created successfully Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577cc4cc-b27c-422c-a6e0-8004e2616e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (cb413caa-bb1e-45b3-83fe-1c7522cd138a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:22 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2902a051-8d52-4b84-9450-baddabaf8287 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created volume successfully. Feb 26 03:08:22 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" returned: 0 in 0.495s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:22 devstack sudo[85652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2 Feb 26 03:08:23 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:23 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c 1073741824" returned: 0 in 0.456s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:23 devstack sudo[85657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c Feb 26 03:08:23 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:23 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" returned: 0 in 0.405s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-f13d34d4-9bd5-43c0-b054-0993bb6b2bb2" released by "delete_volume" :: held 0.927s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['37870680-47f1-4fa3-9ee7-58e47e7deb19'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:23 devstack cinder-volume[83121]: WARNING cinder.quota [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1170811173 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1170811173, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['1d5eccc2-ee41-4779-95c0-bbc67d06ec2d', '19d1f3b6-2137-4443-9917-efd14a3b58e9', '2a20c98b-f7a8-41e9-8035-f3757f3c4138', 'c428537c-d2cf-4e8d-a592-5c227a055cd2'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['a1c59847-19d6-498c-a819-1d6ce376cb42', 'fe309ec2-58fd-4469-b795-5a9d3fdf938f', 'be0254e7-8a44-49f9-8516-a179f6f456c2', '1f983df2-bdd3-4b86-941b-4e2a59b0f46f'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:23 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:23 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:23 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.218s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-578395462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12eb1289-6236-46ee-9559-6e7c3e9eedf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c46e203c964211833e46b2f90dcddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:20Z,use_quota=True,user_id='f8b88f61edf4410ba0fea45d21e7b6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Creating volume 12eb1289-6236-46ee-9559-6e7c3e9eedf5 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:23 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6058f4e3-ffa3-457c-b09e-58c2a37c918b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62b8ce1-9396-403c-bcf4-541f638d996c', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b4167b-2438-4cee-9544-fd3119fca1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:23 devstack sudo[85663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5 1073741824 Feb 26 03:08:23 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume volume-d62b8ce1-9396-403c-bcf4-541f638d996c (d62b8ce1-9396-403c-bcf4-541f638d996c): created successfully Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b4167b-2438-4cee-9544-fd3119fca1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:23 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:23 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (c561d08c-d301-4797-8940-a2865d2365ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:23 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-86b50d37-c244-4f94-835a-8724cf9f97ac tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created volume successfully. Feb 26 03:08:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3fbcd024-92b7-40c1-99dc-d50d030e712d tempest-GroupSnapshotsTest-681902376 None] Group tempest-GroupSnapshotsTest-Group-782951954: creating Feb 26 03:08:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3fbcd024-92b7-40c1-99dc-d50d030e712d tempest-GroupSnapshotsTest-681902376 None] Group tempest-GroupSnapshotsTest-Group-782951954: created successfully Feb 26 03:08:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3fbcd024-92b7-40c1-99dc-d50d030e712d tempest-GroupSnapshotsTest-681902376 None] Create group completed successfully. Feb 26 03:08:24 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.473s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-db61551f-2126-4b99-b367-4ea2ff903a36 tempest-GroupSnapshotsTest-681902376 None] Delete group completed successfully. Feb 26 03:08:24 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5 1073741824" returned: 0 in 0.544s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:24 devstack sudo[85669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5 Feb 26 03:08:24 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:24 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5" returned: 0 in 0.386s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda1650d-c916-4e5f-939a-a37792d4e22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d751b43a-10f6-4e39-a4cb-7f3246cddd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:24 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Volume volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5 (12eb1289-6236-46ee-9559-6e7c3e9eedf5): created successfully Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d751b43a-10f6-4e39-a4cb-7f3246cddd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Flow 'volume_create_manager' (7878add9-cf58-42d8-a280-e73e5497752d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9ab3669b-4f7f-40e0-a894-3a93757a50a6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created volume successfully. Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-12eb1289-6236-46ee-9559-6e7c3e9eedf5-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-12eb1289-6236-46ee-9559-6e7c3e9eedf5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-quobyte-12eb1289-6236-46ee-9559-6e7c3e9eedf5" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-12eb1289-6236-46ee-9559-6e7c3e9eedf5" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0553a8-35a4-4519-afc1-7b247e65cde3]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:25 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5 Feb 26 03:08:25 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Flow 'volume_create_manager' (4bf57401-1ddb-4e9e-b011-440c622877e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6555cb7e-d98f-4935-bd95-02d13453d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6555cb7e-d98f-4935-bd95-02d13453d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1390494985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62095fd2-c9af-41cd-83a8-fca99c4b0420,host='devstack@QuobyteHD#QuobyteHD',id=9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c911722a4c4f35934b05c9a2b91bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:25Z,use_quota=True,user_id='ffd3dc0ab6cc47588ae8ac57768ff25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c53f8eb9-d083-4297-8da3-39b2cff98e5f),volume_type_id=c53f8eb9-d083-4297-8da3-39b2cff98e5f)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cf91a1-70cf-4291-a981-38b0385cf74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cf91a1-70cf-4291-a981-38b0385cf74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cce7c4-a325-449e-be0d-1834e112487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cce7c4-a325-449e-be0d-1834e112487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3', 'volume_name': 'volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fb7580-0832-4584-b316-3216dd11f062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fb7580-0832-4584-b316-3216dd11f062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8036ee90-1f62-47db-901d-86c120b61e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:25 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Volume 9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3', 'volume_size': 1} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62095fd2-c9af-41cd-83a8-fca99c4b0420,created_at=2026-02-26T02:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1390494985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62095fd2-c9af-41cd-83a8-fca99c4b0420,host='devstack@QuobyteHD#QuobyteHD',id=9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c911722a4c4f35934b05c9a2b91bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:25Z,use_quota=True,user_id='ffd3dc0ab6cc47588ae8ac57768ff25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c53f8eb9-d083-4297-8da3-39b2cff98e5f),volume_type_id=c53f8eb9-d083-4297-8da3-39b2cff98e5f)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Creating volume 9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:25 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:25 devstack sudo[85676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 1073741824 Feb 26 03:08:25 devstack sudo[85676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:25 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5" returned: 0 in 0.459s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:25 devstack sudo[85681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5 Feb 26 03:08:25 devstack sudo[85681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:25 devstack sudo[85676]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 1073741824" returned: 0 in 0.445s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:25 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 Feb 26 03:08:25 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:25 devstack sudo[85681]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-12eb1289-6236-46ee-9559-6e7c3e9eedf5" returned: 0 in 0.452s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-12eb1289-6236-46ee-9559-6e7c3e9eedf5" released by "delete_volume" :: held 0.946s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:25 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created reservations ['5f15105c-fb14-44df-b5f2-0bd2bd506bc8', 'ab5a8a2b-aff0-448b-bcd2-1ab19334e2ee', 'ec086ee3-40dd-4200-93ab-fcd907939e7a', 'd25bed60-9ab6-4868-91a0-f08500c80451'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:26 devstack sudo[85689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:26 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-d62b8ce1-9396-403c-bcf4-541f638d996c-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-d62b8ce1-9396-403c-bcf4-541f638d996c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-quobyte-d62b8ce1-9396-403c-bcf4-541f638d996c" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-d62b8ce1-9396-403c-bcf4-541f638d996c" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d34fbe-91a6-49eb-93e6-e417cbd366e9]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:26 devstack sudo[85691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c Feb 26 03:08:26 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:26 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" returned: 0 in 0.479s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8036ee90-1f62-47db-901d-86c120b61e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9151f7a0-306d-4f4c-bec8-d5c76e3f26af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:26 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Volume volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 (9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3): created successfully Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9151f7a0-306d-4f4c-bec8-d5c76e3f26af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Flow 'volume_create_manager' (4bf57401-1ddb-4e9e-b011-440c622877e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-79c453a6-73ab-4a8d-b9a2-61205bab696f tempest-GroupSnapshotsTest-681902376 None] Created volume successfully. Feb 26 03:08:26 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.440s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Deleted volume successfully. Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22939ca-3edc-4774-95cb-d493f3908be6 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-12eb1289-6236-46ee-9559-6e7c3e9eedf5-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] GroupSnapshot 011e0eb2-51c4-4709-8dfa-84d1953949d5: creating. Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Group snapshot 011e0eb2-51c4-4709-8dfa-84d1953949d5: creating. {{(pid=83121) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Creating offline snapshot b849f2ef-07bb-4490-8b3a-554ab072118b of volume 9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef250dc-7fcc-4407-8a15-3d0887f2726c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:26 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c" returned: 0 in 0.482s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:26 devstack sudo[85698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 Feb 26 03:08:26 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:26 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c Feb 26 03:08:26 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:27 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" returned: 0 in 0.456s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:27 devstack sudo[85706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b 1G Feb 26 03:08:27 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:27 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d62b8ce1-9396-403c-bcf4-541f638d996c" returned: 0 in 0.428s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-d62b8ce1-9396-403c-bcf4-541f638d996c" released by "delete_volume" :: held 0.936s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created reservations ['f3f27b3c-f843-4f7b-913b-401f1903f459', 'ce4142a4-ec53-4c5b-a6ee-82db7284c259', '2a77af26-3eef-427f-8be7-3e6d20ebf5c0', '1579db4c-336c-4739-abff-235e60641a56'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:27 devstack sudo[85708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:27 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-042a509a-02d6-4bfe-a916-bf790befe1ea-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-042a509a-02d6-4bfe-a916-bf790befe1ea-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-quobyte-042a509a-02d6-4bfe-a916-bf790befe1ea" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-042a509a-02d6-4bfe-a916-bf790befe1ea" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf59ca4-96a0-435b-a631-a5bccea27b44]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:27 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea Feb 26 03:08:27 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:27 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b 1G" returned: 0 in 0.502s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:27 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b Feb 26 03:08:27 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:27 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.508s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:27 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Deleted volume successfully. Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-8d855c38-6930-4e95-a8d4-c60cc80158ec tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-d62b8ce1-9396-403c-bcf4-541f638d996c-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:27 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea" returned: 0 in 0.487s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:27 devstack sudo[85721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea Feb 26 03:08:27 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:27 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:27 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:08:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:28 devstack sudo[85726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b Feb 26 03:08:28 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:28 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-042a509a-02d6-4bfe-a916-bf790befe1ea" returned: 0 in 0.397s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-042a509a-02d6-4bfe-a916-bf790befe1ea" released by "delete_volume" :: held 0.910s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created reservations ['a60f0e58-fd53-4386-bc73-d2c5437b6945', 'f3fd9fee-8588-495a-85d3-7ffaea324c1b', '04619d2a-3855-44f9-a65e-0cb463f0f963', 'a266e1b7-91cb-4536-9840-0b25ab53eda0'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:28 devstack sudo[85730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:28 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-6977f379-0b4c-45f0-b209-22b3afa45d77-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-6977f379-0b4c-45f0-b209-22b3afa45d77-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-quobyte-6977f379-0b4c-45f0-b209-22b3afa45d77" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-6977f379-0b4c-45f0-b209-22b3afa45d77" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b3bbfa-c918-4dcb-91dc-c7dc1268cf55]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:28 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b" returned: 0 in 0.456s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:28 devstack sudo[85733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.info Feb 26 03:08:28 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:28 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77 Feb 26 03:08:28 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:28 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.453s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:28 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Deleted volume successfully. Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-fa88dafa-74dc-4fc4-9237-758ff8bd483c tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-042a509a-02d6-4bfe-a916-bf790befe1ea-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:28 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.info" returned: 0 in 0.458s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:28 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.info is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:28 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.info Feb 26 03:08:28 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:28 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77" returned: 0 in 0.545s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:28 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77 Feb 26 03:08:28 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:29 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.info" returned: 0 in 0.402s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:29 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6977f379-0b4c-45f0-b209-22b3afa45d77" returned: 0 in 0.411s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-6977f379-0b4c-45f0-b209-22b3afa45d77" released by "delete_volume" :: held 0.982s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:29 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2df81c33-cc02-47e9-9fa1-840dbb38466e tempest-GroupSnapshotsTest-681902376 None] group_snapshot 011e0eb2-51c4-4709-8dfa-84d1953949d5: created successfully Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created reservations ['0503cf5a-1aaf-4241-9b60-e59faa67ec61', 'a42b0795-169a-4593-bee7-c54afa422134', '411a5769-eab4-4590-9caa-0f0012f8ca49', 'f0f14da0-a12d-41d3-a9d7-10b88515d512'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:29 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:29 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-quobyte-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[195b6816-e92a-4807-a612-b83a347467b5]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:29 devstack sudo[85749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c Feb 26 03:08:29 devstack sudo[85749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:29 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] group_snapshot 011e0eb2-51c4-4709-8dfa-84d1953949d5: deleting Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] group_snapshot 011e0eb2-51c4-4709-8dfa-84d1953949d5: deleting {{(pid=83121) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-b849f2ef-07bb-4490-8b3a-554ab072118b" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-b849f2ef-07bb-4490-8b3a-554ab072118b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Deleting offline snapshot b849f2ef-07bb-4490-8b3a-554ab072118b of volume 9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] snapshot_file for this snap is: volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb21bb41-ab43-4448-8351-38343cec44e9]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:29 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.476s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:29 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Deleted volume successfully. Feb 26 03:08:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cc8a9afb-2d94-4886-b607-458446852f40 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-6977f379-0b4c-45f0-b209-22b3afa45d77-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:30 devstack sudo[85752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b Feb 26 03:08:30 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:30 devstack sudo[85749]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c" returned: 0 in 0.601s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:30 devstack sudo[85757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c Feb 26 03:08:30 devstack sudo[85757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:30 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b" returned: 0 in 0.472s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f3f263-f948-4b08-9d93-bed38bcc52da]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:30 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 Feb 26 03:08:30 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:30 devstack sudo[85757]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c" returned: 0 in 0.415s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c" released by "delete_volume" :: held 1.042s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created reservations ['503c28ce-7845-4833-8cf6-63e863adefb9', '616006e4-33e2-4421-8d62-542f98bc8e2a', '2a1cdba5-9789-49b6-a5c7-462592541780', '15b46021-bd9c-4be1-acaf-02091d5df67e'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:30 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:30 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:30 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" returned: 0 in 0.512s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:30 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b Feb 26 03:08:30 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:31 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:31 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Deleted volume successfully. Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7a18fe59-8bc7-4803-ba2a-e64a2e5c707a tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-a9c0ec80-65fd-463b-b2ea-47e3e3a9cf7c-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:31 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b" returned: 0 in 0.464s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:31 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b Feb 26 03:08:31 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-1dc64e1c-6621-4940-8a59-f42d14538f12-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-1dc64e1c-6621-4940-8a59-f42d14538f12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-quobyte-e03fa989-6c27-4a7b-ad81-331c8ed2776b" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-e03fa989-6c27-4a7b-ad81-331c8ed2776b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-quobyte-1dc64e1c-6621-4940-8a59-f42d14538f12" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-1dc64e1c-6621-4940-8a59-f42d14538f12" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Deleting offline snapshot 1dc64e1c-6621-4940-8a59-f42d14538f12 of volume e03fa989-6c27-4a7b-ad81-331c8ed2776b {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] snapshot_file for this snap is: volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63d5df7-e46e-4e36-984c-1d93fe5947be]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:31 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3.b849f2ef-07bb-4490-8b3a-554ab072118b" returned: 0 in 0.393s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-b849f2ef-07bb-4490-8b3a-554ab072118b" released by "_delete_snapshot" :: held 1.899s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" released by "delete_snapshot" :: held 1.909s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:31 devstack sudo[85780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 Feb 26 03:08:31 devstack sudo[85780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:31 devstack cinder-volume[83121]: WARNING cinder.quota [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-159457848 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-159457848, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:08:31 devstack cinder-volume[83121]: WARNING cinder.quota [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-159457848 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-159457848, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['6cae28b4-fc97-489f-b2dd-777f054e6312', '591c32b3-5d95-4fde-b4f2-91164aff6daa', '497fbd80-3a0b-43ca-92c7-fadf76e1f055', '95ae106b-70f2-4857-b94a-c0eb8cba22ac'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:31 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6de55fb9-afb8-4f21-b743-194a6abf5064 tempest-GroupSnapshotsTest-681902376 None] group_snapshot 011e0eb2-51c4-4709-8dfa-84d1953949d5: deleted successfully Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:32 devstack sudo[85782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:32 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "cinder-quobyte-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" acquired by "delete_volume" :: waited 0.017s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb0364-e899-441b-9656-df5e87f465fa]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:32 devstack sudo[85780]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12" returned: 0 in 0.597s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19ca1ac-7a47-430a-9529-6db99ff3ec79]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:32 devstack sudo[85787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 Feb 26 03:08:32 devstack sudo[85787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:32 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b Feb 26 03:08:32 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:32 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.477s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:32 devstack sudo[85787]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" returned: 0 in 0.492s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:32 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3 Feb 26 03:08:32 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:32 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b" returned: 0 in 0.465s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:32 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 Feb 26 03:08:32 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:33 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" returned: 0 in 0.455s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Lock "cinder-quobyte-9c1c1ac8-ed63-4a61-bcfa-0b0b6a9716a3" released by "delete_volume" :: held 0.988s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:33 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:33 devstack sudo[85806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12 Feb 26 03:08:33 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['8926110d-32ca-43d1-9210-43f2c9e077bd'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:33 devstack cinder-volume[83121]: WARNING cinder.quota [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-159457848 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-159457848, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Created reservations ['2746bb82-7a1c-4592-ae63-aeee2795865f', 'ee12bbb0-0f07-4312-aba3-4ce9dad79a3a', '03051968-85d5-4e8c-8ebe-ecf2410118eb', 'a066f3b6-5db0-483e-87b3-b1fd7edd012a'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:33 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:33 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:33 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b.1dc64e1c-6621-4940-8a59-f42d14538f12" returned: 0 in 0.414s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-1dc64e1c-6621-4940-8a59-f42d14538f12" released by "_delete_snapshot" :: held 1.969s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-e03fa989-6c27-4a7b-ad81-331c8ed2776b" released by "delete_snapshot" :: held 1.979s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created reservations ['5079dea4-4379-4499-b1ab-957ecfba5341', '3ab92cb9-750c-4922-9597-3a5def84c101', '9498f078-fd15-4b0e-b0c6-867cc963bf76', '4f558eea-150a-4bf6-9060-7216c0e846b3'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Delete snapshot completed successfully. Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d44fae32-423a-4c8f-90af-27325b915f46 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-1dc64e1c-6621-4940-8a59-f42d14538f12-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-e03fa989-6c27-4a7b-ad81-331c8ed2776b-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-e03fa989-6c27-4a7b-ad81-331c8ed2776b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:33 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9c0f1c0d-6814-4f9f-8a51-554e246075b5 tempest-GroupSnapshotsTest-681902376 None] Delete group completed successfully. Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "cinder-quobyte-e03fa989-6c27-4a7b-ad81-331c8ed2776b" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-e03fa989-6c27-4a7b-ad81-331c8ed2776b" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaacb59-6434-494d-864b-d9f76485ea82]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:33 devstack sudo[85812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b Feb 26 03:08:33 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:34 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b" returned: 0 in 0.477s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:34 devstack sudo[85817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b Feb 26 03:08:34 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:34 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e03fa989-6c27-4a7b-ad81-331c8ed2776b" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-quobyte-e03fa989-6c27-4a7b-ad81-331c8ed2776b" released by "delete_volume" :: held 0.993s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Created reservations ['c1693556-eb11-4028-916d-444cb22981f5', '4d0d0b8c-35e2-4d48-9a62-e3b7fdcf9e84', '2296fe4c-54ef-4e1f-8812-b363fb14d0b8', 'c3e7ebde-b295-4218-a775-b0c05d379e75'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:34 devstack sudo[85820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:34 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:35 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.486s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:35 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:35 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Deleted volume successfully. Feb 26 03:08:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-592ae1f7-57a5-465e-a653-b45f7ab940e1 tempest-CreateVolumesFromSnapshotTest-1571201336 None] Lock "cinder-e03fa989-6c27-4a7b-ad81-331c8ed2776b-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:44 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:INSERT=29,cinder:UPDATE=139,cinder:SELECT=127,cinder:DELETE=7 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:08:45 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=166,cinder:SELECT=125,cinder:DELETE=10,cinder:INSERT=42 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Flow 'volume_create_manager' (356cfa32-9e2d-4e1d-b011-ccba005665f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517ddba6-3c6d-40a8-b34c-a0f5f6f9f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517ddba6-3c6d-40a8-b34c-a0f5f6f9f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1989495142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d956aa47-3da3-4fa1-a8c5-ad69cc709f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a5e7b9b084e53950948ef1bccae5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:48Z,use_quota=True,user_id='f68393df79a041e7ad259f0f49ed079a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c991afb9-af1b-459c-8ce5-0e6bdb17519c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c991afb9-af1b-459c-8ce5-0e6bdb17519c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2df933-eef7-4b2d-b51f-aa76c876c8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2df933-eef7-4b2d-b51f-aa76c876c8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd956aa47-3da3-4fa1-a8c5-ad69cc709f8c', 'volume_name': 'volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0dd8272-10b3-47c8-9872-358b096797dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0dd8272-10b3-47c8-9872-358b096797dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f627b5c-4681-45a4-874c-30a331a74958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:47 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Volume d956aa47-3da3-4fa1-a8c5-ad69cc709f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c', 'volume_size': 1} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1989495142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d956aa47-3da3-4fa1-a8c5-ad69cc709f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a5e7b9b084e53950948ef1bccae5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:48Z,use_quota=True,user_id='f68393df79a041e7ad259f0f49ed079a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Creating volume d956aa47-3da3-4fa1-a8c5-ad69cc709f8c {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:47 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:47 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c 1073741824 Feb 26 03:08:47 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:48 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c 1073741824" returned: 0 in 0.501s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:48 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c Feb 26 03:08:48 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:48 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c" returned: 0 in 0.452s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f627b5c-4681-45a4-874c-30a331a74958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfa19b3-f892-4527-822d-763179e4ba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:48 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Volume volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c (d956aa47-3da3-4fa1-a8c5-ad69cc709f8c): created successfully Feb 26 03:08:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfa19b3-f892-4527-822d-763179e4ba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Flow 'volume_create_manager' (356cfa32-9e2d-4e1d-b011-ccba005665f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:48 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-04f9efa4-bfb1-4d4e-af73-a1edaa051e38 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Created volume successfully. Feb 26 03:08:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Acquiring lock "cinder-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "cinder-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Acquiring lock "cinder-quobyte-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "cinder-quobyte-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:49 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf58e44c-657e-4e15-8489-ee30af6f8822]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:49 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c Feb 26 03:08:49 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:50 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c" returned: 0 in 0.541s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:50 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c Feb 26 03:08:50 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:50 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c" returned: 0 in 0.384s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "cinder-quobyte-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c" released by "delete_volume" :: held 0.946s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Created reservations ['72d5e4ee-1108-4654-9c10-82d2e0d336d1', 'e6093f92-58b4-46e3-bd78-b7031f22c8d4', '0040b4a0-e66c-4a6c-9c6f-6e308797886e', '5a776d80-0f91-47e2-bd3b-40f0f53f593e'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:50 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:50 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Flow 'volume_create_manager' (f89c4a30-5df8-478b-abfe-8d5924843baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e285bb8a-27aa-434c-92b1-c5f248deb65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e285bb8a-27aa-434c-92b1-c5f248deb65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-742287058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41baefba-4a99-4d35-b321-9bc000a61b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a5e7b9b084e53950948ef1bccae5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:51Z,use_quota=True,user_id='f68393df79a041e7ad259f0f49ed079a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9339491a-3a4a-460a-8458-cb4efab57826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9339491a-3a4a-460a-8458-cb4efab57826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c664a867-1680-4a3c-984d-2d01649bccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c664a867-1680-4a3c-984d-2d01649bccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41baefba-4a99-4d35-b321-9bc000a61b09', 'volume_name': 'volume-41baefba-4a99-4d35-b321-9bc000a61b09', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4fe99d-266c-4c44-99d2-0f69ce839763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4fe99d-266c-4c44-99d2-0f69ce839763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa05a363-9fd3-4b3e-b1e1-b4b5d3dd5ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:51 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Volume 41baefba-4a99-4d35-b321-9bc000a61b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41baefba-4a99-4d35-b321-9bc000a61b09', 'volume_size': 1} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-742287058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41baefba-4a99-4d35-b321-9bc000a61b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506a5e7b9b084e53950948ef1bccae5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:08:51Z,use_quota=True,user_id='f68393df79a041e7ad259f0f49ed079a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Creating volume 41baefba-4a99-4d35-b321-9bc000a61b09 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:08:51 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:51 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09 1073741824 Feb 26 03:08:51 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:51 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.547s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:51 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Deleted volume successfully. Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d5bfac67-fd33-4741-8f9b-0b58bd6a82b6 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "cinder-d956aa47-3da3-4fa1-a8c5-ad69cc709f8c-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:51 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09 1073741824" returned: 0 in 0.622s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:51 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09 Feb 26 03:08:51 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:52 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09" returned: 0 in 0.489s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:52 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:08:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa05a363-9fd3-4b3e-b1e1-b4b5d3dd5ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41baefba-4a99-4d35-b321-9bc000a61b09', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6efeb2b-8cb2-4d6d-827d-dee983d4206e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:08:52 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Volume volume-41baefba-4a99-4d35-b321-9bc000a61b09 (41baefba-4a99-4d35-b321-9bc000a61b09): created successfully Feb 26 03:08:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6efeb2b-8cb2-4d6d-827d-dee983d4206e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:08:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Flow 'volume_create_manager' (f89c4a30-5df8-478b-abfe-8d5924843baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:08:52 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9eb7d290-3d3c-41a7-b5f9-94122079ea69 tempest-VolumeQuotasAdminTestJSON-1966653490 None] Created volume successfully. Feb 26 03:08:53 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-ae503535-6e75-4718-b5d5-6c32f73630ed tempest-VolumeQuotasAdminTestJSON-1496784114 None] Transfer volume completed successfully. Feb 26 03:08:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Acquiring lock "cinder-41baefba-4a99-4d35-b321-9bc000a61b09-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Lock "cinder-41baefba-4a99-4d35-b321-9bc000a61b09-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Acquiring lock "cinder-quobyte-41baefba-4a99-4d35-b321-9bc000a61b09" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:08:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Lock "cinder-quobyte-41baefba-4a99-4d35-b321-9bc000a61b09" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:08:54 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb9eaa2-fce6-43e2-8cf0-8d79808b3c1d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:08:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:54 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09 Feb 26 03:08:54 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:54 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09" returned: 0 in 0.480s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:54 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09 Feb 26 03:08:54 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:55 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41baefba-4a99-4d35-b321-9bc000a61b09" returned: 0 in 0.430s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Lock "cinder-quobyte-41baefba-4a99-4d35-b321-9bc000a61b09" released by "delete_volume" :: held 0.935s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Created reservations ['6b7e5922-bb3f-4423-98d5-dcf5c0fccadd', '1405bdf2-7aaf-461b-8467-f09a8ddf1bbe', '1bfff455-eb89-4fd5-a344-2d3472cb686a', '4aecead7-69a8-4b1e-8df7-70ae94dc32d1'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:08:55 devstack sudo[85909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:08:55 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:08:55 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.477s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:08:55 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Deleted volume successfully. Feb 26 03:08:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-787f7100-3507-42f9-bd55-878c09f6e282 tempest-VolumeQuotasAdminTestJSON-1273301495 None] Lock "cinder-41baefba-4a99-4d35-b321-9bc000a61b09-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Flow 'volume_create_manager' (172eb962-6303-4de6-81b6-eeef2705deca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0effa04-caf4-4e20-8115-ebbd7e71b678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0effa04-caf4-4e20-8115-ebbd7e71b678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1315428259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f26d8d5-3a56-4465-8957-9f0eee320168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c7d3c36b00410992aa5f08252dc044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:00Z,use_quota=True,user_id='cfc88372127b4f978c222a6bcead5c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d25ac9-4896-46a9-bda7-9e2d7b647484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d25ac9-4896-46a9-bda7-9e2d7b647484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16a0b2a-ad72-4521-bdd2-bed21ee27519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16a0b2a-ad72-4521-bdd2-bed21ee27519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f26d8d5-3a56-4465-8957-9f0eee320168', 'volume_name': 'volume-6f26d8d5-3a56-4465-8957-9f0eee320168', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ab8f48-0fcc-4e04-9808-47c944141891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ab8f48-0fcc-4e04-9808-47c944141891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05358275-34a2-43ef-939b-a405be50f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:00 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Volume 6f26d8d5-3a56-4465-8957-9f0eee320168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f26d8d5-3a56-4465-8957-9f0eee320168', 'volume_size': 1} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1315428259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f26d8d5-3a56-4465-8957-9f0eee320168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c7d3c36b00410992aa5f08252dc044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:00Z,use_quota=True,user_id='cfc88372127b4f978c222a6bcead5c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Creating volume 6f26d8d5-3a56-4465-8957-9f0eee320168 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:09:00 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:00 devstack sudo[85952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168 1073741824 Feb 26 03:09:00 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:00 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168 1073741824" returned: 0 in 0.454s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:00 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168 Feb 26 03:09:00 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:00 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168" returned: 0 in 0.392s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05358275-34a2-43ef-939b-a405be50f07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f26d8d5-3a56-4465-8957-9f0eee320168', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d5605b-2a88-4c87-b34b-ac4fd75bd83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:00 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Volume volume-6f26d8d5-3a56-4465-8957-9f0eee320168 (6f26d8d5-3a56-4465-8957-9f0eee320168): created successfully Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d5605b-2a88-4c87-b34b-ac4fd75bd83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Flow 'volume_create_manager' (172eb962-6303-4de6-81b6-eeef2705deca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:00 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2e33a3fe-cc4e-47d3-8090-36cd14b96830 tempest-VolumesServicesTestJSON-211472901 None] Created volume successfully. Feb 26 03:09:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Acquiring lock "cinder-6f26d8d5-3a56-4465-8957-9f0eee320168-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Lock "cinder-6f26d8d5-3a56-4465-8957-9f0eee320168-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Acquiring lock "cinder-quobyte-6f26d8d5-3a56-4465-8957-9f0eee320168" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Lock "cinder-quobyte-6f26d8d5-3a56-4465-8957-9f0eee320168" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:01 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1c6006-4eb0-4a9e-a0c0-43a45c3e4831]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:01 devstack sudo[85961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168 Feb 26 03:09:01 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:01 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168" returned: 0 in 0.444s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:01 devstack sudo[85966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168 Feb 26 03:09:01 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:02 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6f26d8d5-3a56-4465-8957-9f0eee320168" returned: 0 in 0.423s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Lock "cinder-quobyte-6f26d8d5-3a56-4465-8957-9f0eee320168" released by "delete_volume" :: held 0.888s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Created reservations ['74a4ac33-4c6b-4a5f-b7ba-25fa0239300e', 'b39ef853-c21a-450f-a897-19136d26a8be', '9bf0d8d2-0fa0-4ac7-9dca-f53c7a5933cc', 'dab247ff-a4d4-402e-b525-816e17d0a276'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:02 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:09:02 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:02 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:09:02 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Deleted volume successfully. Feb 26 03:09:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-941b59cb-9a15-46e8-ace3-1ce9fbf411e4 tempest-VolumesServicesTestJSON-211472901 None] Lock "cinder-6f26d8d5-3a56-4465-8957-9f0eee320168-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Flow 'volume_create_manager' (4e35db99-d2bb-4e73-9b20-926b209fbb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e30737-9592-473f-9ba3-3b55e53690fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e30737-9592-473f-9ba3-3b55e53690fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-146189740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0eed36-4875-4e72-a78f-e0c7a0907e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bbcb904bc14452b885003e71c65c76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:06Z,use_quota=True,user_id='bec33401336e48388d35dbd6fe2d9eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5570f5e-09ab-4bca-a91c-753e8c188eae),volume_type_id=f5570f5e-09ab-4bca-a91c-753e8c188eae)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9f0090-0a71-468d-9d0c-6fd7fd8c6ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9f0090-0a71-468d-9d0c-6fd7fd8c6ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3e0439-8bf2-4593-8718-454722f33ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3e0439-8bf2-4593-8718-454722f33ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed0eed36-4875-4e72-a78f-e0c7a0907e87', 'volume_name': 'volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cfadc2-913a-4dff-a3cc-691ff25c149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cfadc2-913a-4dff-a3cc-691ff25c149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f704b71-6ef4-4bc3-845a-015594e018ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:05 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Volume ed0eed36-4875-4e72-a78f-e0c7a0907e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87', 'volume_size': 1} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-146189740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0eed36-4875-4e72-a78f-e0c7a0907e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bbcb904bc14452b885003e71c65c76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:06Z,use_quota=True,user_id='bec33401336e48388d35dbd6fe2d9eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5570f5e-09ab-4bca-a91c-753e8c188eae),volume_type_id=f5570f5e-09ab-4bca-a91c-753e8c188eae)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Creating volume ed0eed36-4875-4e72-a78f-e0c7a0907e87 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:09:05 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:09:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:05 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87 1073741824 Feb 26 03:09:05 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:06 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87 1073741824" returned: 0 in 0.483s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:06 devstack sudo[85977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87 Feb 26 03:09:06 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:06 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87" returned: 0 in 0.428s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:06 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:09:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:06 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f704b71-6ef4-4bc3-845a-015594e018ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:06 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4953d6c5-6301-4d41-8bf6-c2c24b38b46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:06 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Volume volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87 (ed0eed36-4875-4e72-a78f-e0c7a0907e87): created successfully Feb 26 03:09:06 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4953d6c5-6301-4d41-8bf6-c2c24b38b46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:06 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Flow 'volume_create_manager' (4e35db99-d2bb-4e73-9b20-926b209fbb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:06 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-94a83a4f-b183-4fdc-beba-392b62e94f62 tempest-VolumeTypesAccessTest-2073736387 None] Created volume successfully. Feb 26 03:09:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Acquiring lock "cinder-ed0eed36-4875-4e72-a78f-e0c7a0907e87-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Lock "cinder-ed0eed36-4875-4e72-a78f-e0c7a0907e87-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Acquiring lock "cinder-quobyte-ed0eed36-4875-4e72-a78f-e0c7a0907e87" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Lock "cinder-quobyte-ed0eed36-4875-4e72-a78f-e0c7a0907e87" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:07 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c78f89-f2e4-4ed2-99e8-ea3feb996dc5]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:07 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87 Feb 26 03:09:07 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:08 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87" returned: 0 in 0.497s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:08 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87 Feb 26 03:09:08 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:08 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ed0eed36-4875-4e72-a78f-e0c7a0907e87" returned: 0 in 0.401s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Lock "cinder-quobyte-ed0eed36-4875-4e72-a78f-e0c7a0907e87" released by "delete_volume" :: held 0.929s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:08 devstack cinder-volume[83121]: WARNING cinder.quota [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1878577018 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1878577018, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:09:08 devstack cinder-volume[83121]: WARNING cinder.quota [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1878577018 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1878577018, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Created reservations ['7584a1d1-6e64-46d2-97aa-24ef9a9b2ba5', 'f3d518ac-d31b-487f-988f-c2462c68c016', '22c722ae-63b4-4458-978f-4b15af2e69d1', '3a8b2847-89d6-428a-8269-950a1fba1264'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:08 devstack sudo[86029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:09:08 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:09 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:09 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:09:09 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Deleted volume successfully. Feb 26 03:09:09 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-752c4ee0-47e3-4016-86e0-6520c07f8656 tempest-VolumeTypesAccessTest-2073736387 None] Lock "cinder-ed0eed36-4875-4e72-a78f-e0c7a0907e87-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Flow 'volume_create_manager' (dbf1eed9-a348-41e2-b983-37f3e44d3d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414173d5-800e-4673-8958-1d6b6fc3eb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414173d5-800e-4673-8958-1d6b6fc3eb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1613534446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ca28abc754da2990cbece800acbff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:16Z,use_quota=True,user_id='63ed6b3a67d744d984d5116d141923ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e2e455-07a8-4526-8bdf-3c530dc3f405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e2e455-07a8-4526-8bdf-3c530dc3f405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ae58fb-ca9a-476f-8c47-6f9f0343ec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.image.glance [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Creating Keystone auth plugin from conf {{(pid=83121) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ae58fb-ca9a-476f-8c47-6f9f0343ec37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b', 'volume_name': 'volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99f1b24-2b7c-42d7-a69e-e89425616de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99f1b24-2b7c-42d7-a69e-e89425616de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20bd22d-5220-46df-9dcf-f778ba315596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:15 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Volume 6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Trying to clone 6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b from image 95c0faf7-23d7-4587-ab20-846f22462e10 at location (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]). {{(pid=83121) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 26 03:09:15 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 26 03:09:15 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Image download 20.69 MB at 20.69 MB/s Feb 26 03:09:16 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[940325f6-a2ae-4729-bfc5-defaca87257b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:16 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD Feb 26 03:09:16 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:16 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:16 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Temporary image 95c0faf7-23d7-4587-ab20-846f22462e10 is fetched for user 63ed6b3a67d744d984d5116d141923ac. {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 26 03:09:16 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85431c2-f4c9-4945-b1c0-c50650270d1f]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:16 devstack sudo[86059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD Feb 26 03:09:16 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:17 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1613534446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ca28abc754da2990cbece800acbff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:16Z,use_quota=True,user_id='63ed6b3a67d744d984d5116d141923ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Creating volume 6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:09:17 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:17 devstack sudo[86064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b 1073741824 Feb 26 03:09:17 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:17 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b 1073741824" returned: 0 in 0.444s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:17 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b Feb 26 03:09:17 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:17 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b" returned: 0 in 0.406s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Attempting download of 95c0faf7-23d7-4587-ab20-846f22462e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}])) to volume 6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b. {{(pid=83121) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e689c42f-8ecd-48e0-939f-6204da96e1d6]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_vnpjjvri {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:18 devstack sudo[86072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_vnpjjvri Feb 26 03:09:18 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:18 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_vnpjjvri" returned: 0 in 0.466s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_vnpjjvri {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:18 devstack sudo[86076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_vnpjjvri Feb 26 03:09:18 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:18 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_vnpjjvri" returned: 1 in 0.453s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_vnpjjvri' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:09:18 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d5fac2-ce91-4422-90c3-3aa54b86dc9e]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:18 devstack sudo[86080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD Feb 26 03:09:18 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:19 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:19 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] 95c0faf7-23d7-4587-ab20-846f22462e10 was qcow2, converting to raw {{(pid=83121) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 26 03:09:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:19 devstack sudo[86085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b Feb 26 03:09:19 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:20 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b" returned: 0 in 0.857s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:20 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_kijx4ybndevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:09:20 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Converted 112.00 MB image at 112.00 MB/s Feb 26 03:09:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:20 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b 1G Feb 26 03:09:20 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:20 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b 1G" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:20 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c8b16e-1ad9-416e-9bd2-da8355d063f9]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:20 devstack sudo[86104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b Feb 26 03:09:20 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:21 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b" returned: 0 in 0.474s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:21 devstack sudo[86108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b Feb 26 03:09:21 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:21 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b" returned: 1 in 0.459s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Downloaded image 95c0faf7-23d7-4587-ab20-846f22462e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}])) to volume 6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b successfully. {{(pid=83121) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Temporary image 95c0faf7-23d7-4587-ab20-846f22462e10 for user 63ed6b3a67d744d984d5116d141923ac is deleted. {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Marking volume 6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b as bootable. {{(pid=83121) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Copying metadata from image 95c0faf7-23d7-4587-ab20-846f22462e10 to 6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b. {{(pid=83121) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Creating volume glance metadata for volume 6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b backed by image 95c0faf7-23d7-4587-ab20-846f22462e10 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83121) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20bd22d-5220-46df-9dcf-f778ba315596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4a1d91-9b69-4685-bb35-b0eed80cbaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:21 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Volume volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b (6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b): created successfully Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4a1d91-9b69-4685-bb35-b0eed80cbaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Flow 'volume_create_manager' (dbf1eed9-a348-41e2-b983-37f3e44d3d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:21 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-56e860c1-2c6b-4a15-974e-2ddb4dc1ab63 tempest-VolumesImageMetadata-1029858211 None] Created volume successfully. Feb 26 03:09:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Acquiring lock "cinder-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Lock "cinder-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Acquiring lock "cinder-quobyte-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Lock "cinder-quobyte-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:22 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb485090-f6f8-4879-9e06-35d581ba59b2]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:22 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b Feb 26 03:09:22 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:22 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:22 devstack sudo[86118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b Feb 26 03:09:22 devstack sudo[86118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:23 devstack sudo[86118]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b" returned: 1 in 0.468s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:23 devstack sudo[86123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b Feb 26 03:09:23 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:23 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b" returned: 0 in 0.420s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Lock "cinder-quobyte-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b" released by "delete_volume" :: held 1.391s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Created reservations ['5a4f0468-2df7-4b67-a679-4f2b888c1227', 'd6099fa9-5702-4ae2-97bb-35df7de63c08', '370eba63-81b0-4160-b501-4bf56d8e84cc', '095ca6fe-67d0-4613-9bca-8f9c9227c074'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:23 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:09:23 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:24 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.409s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:24 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:09:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Deleted volume successfully. Feb 26 03:09:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9f45ce5-fbcf-49ba-b645-8796640ab04d tempest-VolumesImageMetadata-1029858211 None] Lock "cinder-6ea2b5d3-ad3e-4a62-8231-4f0a582ee58b-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Flow 'volume_create_manager' (f11cf181-f0f1-442c-bef7-d30b4051bc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19df963d-c5d4-47a5-98ca-83b1d3d99530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19df963d-c5d4-47a5-98ca-83b1d3d99530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-874111039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d74bf4-94d3-4700-924e-26f1654a9457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ad10cb9ac944a3be14c4fdf4f173bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:26Z,use_quota=True,user_id='96a07371789d4404913b03b360928489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f4478f-589e-4c60-945c-7491f49fc64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f4478f-589e-4c60-945c-7491f49fc64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d9713a-d4cf-4dd3-a223-ed37cc42094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d9713a-d4cf-4dd3-a223-ed37cc42094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d74bf4-94d3-4700-924e-26f1654a9457', 'volume_name': 'volume-25d74bf4-94d3-4700-924e-26f1654a9457', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f0dbe3-d506-4d26-bda1-64cb9cd9d831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f0dbe3-d506-4d26-bda1-64cb9cd9d831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49dcff0d-23d0-4fbf-98b6-68fce083fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:25 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Volume 25d74bf4-94d3-4700-924e-26f1654a9457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d74bf4-94d3-4700-924e-26f1654a9457', 'volume_size': 1} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-874111039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d74bf4-94d3-4700-924e-26f1654a9457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ad10cb9ac944a3be14c4fdf4f173bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:26Z,use_quota=True,user_id='96a07371789d4404913b03b360928489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Creating volume 25d74bf4-94d3-4700-924e-26f1654a9457 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:09:25 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:09:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:25 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 1073741824 Feb 26 03:09:25 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:26 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 1073741824" returned: 0 in 0.476s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:26 devstack sudo[86136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 Feb 26 03:09:26 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:26 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457" returned: 0 in 0.416s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:09:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49dcff0d-23d0-4fbf-98b6-68fce083fe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d74bf4-94d3-4700-924e-26f1654a9457', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c86e0ec-5e32-47b1-96de-94231dde399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:26 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Volume volume-25d74bf4-94d3-4700-924e-26f1654a9457 (25d74bf4-94d3-4700-924e-26f1654a9457): created successfully Feb 26 03:09:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c86e0ec-5e32-47b1-96de-94231dde399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Flow 'volume_create_manager' (f11cf181-f0f1-442c-bef7-d30b4051bc91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8e71cef2-b315-4eec-805e-67a47b962f19 tempest-VolumesDeleteCascade-279008029 None] Created volume successfully. Feb 26 03:09:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Creating offline snapshot 738ba459-fc31-412f-a41d-361312654415 of volume 25d74bf4-94d3-4700-924e-26f1654a9457 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:09:28 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[06861fc3-d4ee-4052-9927-28cdd1aefbbc]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:28 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 Feb 26 03:09:28 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:28 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457" returned: 0 in 0.473s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:28 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 1G Feb 26 03:09:28 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:29 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 1G" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d74bf4-94d3-4700-924e-26f1654a9457 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:29 devstack sudo[86149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d74bf4-94d3-4700-924e-26f1654a9457 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 Feb 26 03:09:29 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:29 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d74bf4-94d3-4700-924e-26f1654a9457 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415" returned: 0 in 0.444s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:29 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 is being set with open permissions: ugo+rw Feb 26 03:09:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:29 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 Feb 26 03:09:29 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:29 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415" returned: 0 in 0.406s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:29 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.info Feb 26 03:09:29 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:30 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.info" returned: 0 in 0.402s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:30 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.info is being set with open permissions: ugo+rw Feb 26 03:09:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:30 devstack sudo[86160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.info Feb 26 03:09:30 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:30 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.info" returned: 0 in 0.409s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:30 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5b764dc7-19d9-46a4-aa6f-959de3dee8f4 tempest-VolumesDeleteCascade-279008029 None] Create snapshot completed successfully Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] Creating offline snapshot 6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 of volume 25d74bf4-94d3-4700-924e-26f1654a9457 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[107eadf3-babc-432d-a428-4bdc4377b1f2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:31 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 Feb 26 03:09:31 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:31 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415" returned: 0 in 0.493s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25d74bf4-94d3-4700-924e-26f1654a9457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:31 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 1G Feb 26 03:09:31 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:32 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:09:32 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:32 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 1G" returned: 0 in 0.487s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:32 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 Feb 26 03:09:32 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:32 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.456s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:09:32 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462" returned: 0 in 0.418s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:32 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 is being set with open permissions: ugo+rw Feb 26 03:09:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:32 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 Feb 26 03:09:32 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:33 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462" returned: 0 in 0.424s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-fceb4dcf-238b-4a18-9f50-e3e3598f3834 tempest-VolumesDeleteCascade-279008029 None] Create snapshot completed successfully Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-25d74bf4-94d3-4700-924e-26f1654a9457-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-25d74bf4-94d3-4700-924e-26f1654a9457-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Performing cascade delete. {{(pid=83121) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-6b0f95ab-7bae-45d9-a6ac-4da0c7a92462-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-6b0f95ab-7bae-45d9-a6ac-4da0c7a92462-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-25d74bf4-94d3-4700-924e-26f1654a9457" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-25d74bf4-94d3-4700-924e-26f1654a9457" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-6b0f95ab-7bae-45d9-a6ac-4da0c7a92462" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-6b0f95ab-7bae-45d9-a6ac-4da0c7a92462" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Deleting offline snapshot 6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 of volume 25d74bf4-94d3-4700-924e-26f1654a9457 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] snapshot_file for this snap is: volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a07b5d-d50f-45b8-bd85-ded976d4d4a7]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:33 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 Feb 26 03:09:33 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:33 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462" returned: 0 in 0.488s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25d74bf4-94d3-4700-924e-26f1654a9457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f27c4d6-95f8-4928-9bb3-516dd008dd82]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:34 devstack sudo[86190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 Feb 26 03:09:34 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:34 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415" returned: 0 in 0.492s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25d74bf4-94d3-4700-924e-26f1654a9457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:09:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:34 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 Feb 26 03:09:34 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:34 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:34 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462 Feb 26 03:09:34 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:35 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.6b0f95ab-7bae-45d9-a6ac-4da0c7a92462" returned: 0 in 0.403s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-6b0f95ab-7bae-45d9-a6ac-4da0c7a92462" released by "_delete_snapshot" :: held 1.874s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-25d74bf4-94d3-4700-924e-26f1654a9457" released by "delete_snapshot" :: held 1.884s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Created reservations ['8844e1bd-cecd-4a76-9ee8-e67f1009285a', '5ab595c7-bfd7-49c6-965d-4c222fe33263', '8df8f1ad-207e-4527-9205-2c7fcdaeef73', 'f1f55a8e-ba32-43f5-931b-37dbdce93efb'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:09:35 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Delete snapshot completed successfully. Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-6b0f95ab-7bae-45d9-a6ac-4da0c7a92462-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-738ba459-fc31-412f-a41d-361312654415-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-738ba459-fc31-412f-a41d-361312654415-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-25d74bf4-94d3-4700-924e-26f1654a9457" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-25d74bf4-94d3-4700-924e-26f1654a9457" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-738ba459-fc31-412f-a41d-361312654415" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-738ba459-fc31-412f-a41d-361312654415" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Deleting offline snapshot 738ba459-fc31-412f-a41d-361312654415 of volume 25d74bf4-94d3-4700-924e-26f1654a9457 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] snapshot_file for this snap is: volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc43024-9648-421e-aa13-e1829c4d5c5b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:35 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 Feb 26 03:09:35 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:35 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415" returned: 0 in 0.492s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25d74bf4-94d3-4700-924e-26f1654a9457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8617608-7daf-404c-941b-80cb9a7fdd68]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:36 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 Feb 26 03:09:36 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:36 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457" returned: 0 in 0.501s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:36 devstack sudo[86213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 Feb 26 03:09:36 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:36 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415" returned: 0 in 0.463s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:36 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415 Feb 26 03:09:36 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:37 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457.738ba459-fc31-412f-a41d-361312654415" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-738ba459-fc31-412f-a41d-361312654415" released by "_delete_snapshot" :: held 1.906s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-25d74bf4-94d3-4700-924e-26f1654a9457" released by "delete_snapshot" :: held 1.921s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Created reservations ['0e3796eb-0f0b-4380-839f-af3ab1246585', 'b398e3d8-e4c4-4111-a8e2-adeb8d988860', '418c5d99-9576-4985-ab8f-22f498ffe7c6', '50551f5c-80b4-4e70-bf10-e89401902c1f'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:09:37 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Delete snapshot completed successfully. Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-738ba459-fc31-412f-a41d-361312654415-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Snapshots deleted, issuing volume delete {{(pid=83121) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-25d74bf4-94d3-4700-924e-26f1654a9457" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-25d74bf4-94d3-4700-924e-26f1654a9457" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e89d710-7217-4e06-81df-72746b776d25]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:37 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 Feb 26 03:09:37 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:37 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457" returned: 0 in 0.508s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:37 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457 Feb 26 03:09:37 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:38 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-25d74bf4-94d3-4700-924e-26f1654a9457" returned: 0 in 0.386s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-25d74bf4-94d3-4700-924e-26f1654a9457" released by "delete_volume" :: held 0.920s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Created reservations ['dad6b001-503f-456e-b0d0-d9d135caeed7', '23249a3a-c9d5-4103-a1ee-a64670a840fe', 'b0b1afec-6643-4e21-b293-d0ad39527cc5', 'a8059b2f-6e9e-4f33-b300-711233ac585b'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:38 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:09:38 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:38 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.419s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:09:38 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Deleted volume successfully. Feb 26 03:09:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-90eb1281-714f-4eed-bdbf-5b2f66fedeb1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-25d74bf4-94d3-4700-924e-26f1654a9457-delete_volume" released by "delete_volume" :: held 5.464s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Flow 'volume_create_manager' (8a412993-d93a-4800-a6b9-077289f44d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bada5fa0-d861-4ffb-bcfe-208e394824d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bada5fa0-d861-4ffb-bcfe-208e394824d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-610788378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b53856b-0d87-48ad-9f5c-80c765d656a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ad10cb9ac944a3be14c4fdf4f173bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:39Z,use_quota=True,user_id='96a07371789d4404913b03b360928489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123b93bb-4063-4092-ad64-69bf46035376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123b93bb-4063-4092-ad64-69bf46035376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b2dfe1-1876-4a6f-9b7a-a214dbb8d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b2dfe1-1876-4a6f-9b7a-a214dbb8d821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b53856b-0d87-48ad-9f5c-80c765d656a8', 'volume_name': 'volume-2b53856b-0d87-48ad-9f5c-80c765d656a8', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8be68d2-3826-4863-8ea7-d7b298619c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8be68d2-3826-4863-8ea7-d7b298619c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ef3c01-e3c8-4ebf-9ae0-84832f03ca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:39 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Volume 2b53856b-0d87-48ad-9f5c-80c765d656a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b53856b-0d87-48ad-9f5c-80c765d656a8', 'volume_size': 1} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-610788378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b53856b-0d87-48ad-9f5c-80c765d656a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ad10cb9ac944a3be14c4fdf4f173bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:39Z,use_quota=True,user_id='96a07371789d4404913b03b360928489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Creating volume 2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:09:39 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:39 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 1073741824 Feb 26 03:09:39 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:39 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 1073741824" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:39 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 Feb 26 03:09:39 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:40 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8" returned: 0 in 0.408s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:09:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ef3c01-e3c8-4ebf-9ae0-84832f03ca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b53856b-0d87-48ad-9f5c-80c765d656a8', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0419ec-9a2a-416e-a0a8-63dcec421366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:40 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Volume volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 (2b53856b-0d87-48ad-9f5c-80c765d656a8): created successfully Feb 26 03:09:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0419ec-9a2a-416e-a0a8-63dcec421366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Flow 'volume_create_manager' (8a412993-d93a-4800-a6b9-077289f44d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:40 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-23db19f0-737f-4dca-9cca-e2d66de32c0b tempest-VolumesDeleteCascade-279008029 None] Created volume successfully. Feb 26 03:09:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Creating offline snapshot c79a7764-8de2-416d-ae6d-21e47b3f1dea of volume 2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:09:41 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dbf432-8ab0-4c53-bd35-4e9bf7e61dce]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:41 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 Feb 26 03:09:41 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:41 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8" returned: 0 in 0.457s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:41 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea 1G Feb 26 03:09:41 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:42 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea 1G" returned: 0 in 0.466s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:42 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea Feb 26 03:09:42 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:42 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea" returned: 0 in 0.435s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:42 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea is being set with open permissions: ugo+rw Feb 26 03:09:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:42 devstack sudo[86256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea Feb 26 03:09:42 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:43 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea" returned: 0 in 0.388s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:43 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.info Feb 26 03:09:43 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:43 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.info" returned: 0 in 0.418s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:43 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.info is being set with open permissions: ugo+rw Feb 26 03:09:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:43 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.info Feb 26 03:09:43 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:43 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.info" returned: 0 in 0.391s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.612s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:43 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-aaf38b73-c30b-4803-821f-644d5a45638f tempest-VolumesDeleteCascade-279008029 None] Create snapshot completed successfully Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Flow 'volume_create_manager' (c94e8ecf-a851-448e-afab-1cb8aab8a86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd929621-54f1-4751-b55f-7209eaf734b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd929621-54f1-4751-b55f-7209eaf734b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1410358888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5ecc1e-f808-427c-b5cd-9394c864146f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ad10cb9ac944a3be14c4fdf4f173bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c79a7764-8de2-416d-ae6d-21e47b3f1dea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:45Z,use_quota=True,user_id='96a07371789d4404913b03b360928489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143515e6-dd2c-4b67-8ca9-3208e72178c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143515e6-dd2c-4b67-8ca9-3208e72178c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86074e19-d309-486e-a0bb-fb0d977c3ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86074e19-d309-486e-a0bb-fb0d977c3ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b5ecc1e-f808-427c-b5cd-9394c864146f', 'volume_name': 'volume-5b5ecc1e-f808-427c-b5cd-9394c864146f', 'volume_size': 1, 'snapshot_id': 'c79a7764-8de2-416d-ae6d-21e47b3f1dea'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57376294-81a6-421a-9fa5-1157b4c54054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57376294-81a6-421a-9fa5-1157b4c54054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edc2a78-fcb6-4f12-8b97-c8dec28ff0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:44 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Volume 5b5ecc1e-f808-427c-b5cd-9394c864146f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b5ecc1e-f808-427c-b5cd-9394c864146f', 'volume_size': 1, 'snapshot_id': 'c79a7764-8de2-416d-ae6d-21e47b3f1dea'} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-c79a7764-8de2-416d-ae6d-21e47b3f1dea-5b5ecc1e-f808-427c-b5cd-9394c864146f" by "_create_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-c79a7764-8de2-416d-ae6d-21e47b3f1dea-5b5ecc1e-f808-427c-b5cd-9394c864146f" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Creating volume 5b5ecc1e-f808-427c-b5cd-9394c864146f from snapshot c79a7764-8de2-416d-ae6d-21e47b3f1dea {{(pid=83121) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-5b5ecc1e-f808-427c-b5cd-9394c864146f" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-5b5ecc1e-f808-427c-b5cd-9394c864146f" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] snapshot: c79a7764-8de2-416d-ae6d-21e47b3f1dea, volume: 5b5ecc1e-f808-427c-b5cd-9394c864146f, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[960f7318-fb84-4784-89e8-0a83557554f3]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:44 devstack sudo[86265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea Feb 26 03:09:44 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:45 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea" returned: 0 in 0.468s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b53856b-0d87-48ad-9f5c-80c765d656a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:09:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:09:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:09:45 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8043384f-4614-475a-948e-b8aa635bce87]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:45 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 Feb 26 03:09:45 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:45 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8" returned: 0 in 0.477s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:45 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:09:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:45 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f Feb 26 03:09:45 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:47 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f" returned: 0 in 2.032s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:47 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc136cc-c675-46cc-a7fc-6e5c31f8e37c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:47 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 Feb 26 03:09:47 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:48 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8" returned: 0 in 0.576s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:09:48 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Converted 1024.00 MB image at 503.49 MB/s Feb 26 03:09:48 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f is being set with open permissions: ugo+rw Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:48 devstack sudo[86293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f Feb 26 03:09:48 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:48 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f" returned: 0 in 0.418s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-5b5ecc1e-f808-427c-b5cd-9394c864146f" released by "_copy_volume_from_snapshot" :: held 4.033s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-c79a7764-8de2-416d-ae6d-21e47b3f1dea-5b5ecc1e-f808-427c-b5cd-9394c864146f" released by "_create_volume_from_snapshot" :: held 4.052s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.062s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=84,cinder:UPDATE=89,cinder:INSERT=20,cinder:DELETE=10 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=85,cinder:SELECT=66,cinder:INSERT=34,cinder:DELETE=6 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edc2a78-fcb6-4f12-8b97-c8dec28ff0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5ecc1e-f808-427c-b5cd-9394c864146f', 'volume_size': 1, 'snapshot_id': 'c79a7764-8de2-416d-ae6d-21e47b3f1dea'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a11116-b29c-40be-be58-8a5ae58195d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:48 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Volume volume-5b5ecc1e-f808-427c-b5cd-9394c864146f (5b5ecc1e-f808-427c-b5cd-9394c864146f): created successfully Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a11116-b29c-40be-be58-8a5ae58195d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Flow 'volume_create_manager' (c94e8ecf-a851-448e-afab-1cb8aab8a86c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:48 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-34e56fc6-6e05-4e30-b91d-d95b769b83e4 tempest-VolumesDeleteCascade-279008029 None] Created volume successfully. Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-2b53856b-0d87-48ad-9f5c-80c765d656a8-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-2b53856b-0d87-48ad-9f5c-80c765d656a8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Performing cascade delete. {{(pid=83121) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-c79a7764-8de2-416d-ae6d-21e47b3f1dea-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-c79a7764-8de2-416d-ae6d-21e47b3f1dea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-2b53856b-0d87-48ad-9f5c-80c765d656a8" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-2b53856b-0d87-48ad-9f5c-80c765d656a8" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-c79a7764-8de2-416d-ae6d-21e47b3f1dea" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-c79a7764-8de2-416d-ae6d-21e47b3f1dea" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Deleting offline snapshot c79a7764-8de2-416d-ae6d-21e47b3f1dea of volume 2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] snapshot_file for this snap is: volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[07576ef0-0362-4e38-9be9-e2b06e5f8e3c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:50 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea Feb 26 03:09:50 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:50 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea" returned: 0 in 0.468s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b53856b-0d87-48ad-9f5c-80c765d656a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc31677b-fa89-4e83-847a-ea4e955a9ba6]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:50 devstack sudo[86301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 Feb 26 03:09:50 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:51 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8" returned: 0 in 0.488s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:51 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea Feb 26 03:09:51 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:51 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea" returned: 0 in 0.461s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:51 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea Feb 26 03:09:51 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:51 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8.c79a7764-8de2-416d-ae6d-21e47b3f1dea" returned: 0 in 0.400s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-c79a7764-8de2-416d-ae6d-21e47b3f1dea" released by "_delete_snapshot" :: held 1.869s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-2b53856b-0d87-48ad-9f5c-80c765d656a8" released by "delete_snapshot" :: held 1.880s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:52 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Created reservations ['a7fd992e-ca94-428e-af88-9470ff333305', 'cbbfa226-d238-480d-a526-df99dfa6cb71', '7d2db91c-8f18-4716-9733-b5a06e55bed2', 'a5e8206d-0185-4c0d-b6b8-6b50067a461d'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:09:52 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Delete snapshot completed successfully. Feb 26 03:09:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-c79a7764-8de2-416d-ae6d-21e47b3f1dea-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:52 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Snapshots deleted, issuing volume delete {{(pid=83121) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 26 03:09:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-2b53856b-0d87-48ad-9f5c-80c765d656a8" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-2b53856b-0d87-48ad-9f5c-80c765d656a8" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:52 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deb3462-fb24-4e94-9221-c23337f8805f]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:52 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 Feb 26 03:09:52 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:52 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8" returned: 0 in 0.505s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:52 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8 Feb 26 03:09:52 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:52 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b53856b-0d87-48ad-9f5c-80c765d656a8" returned: 0 in 0.405s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-2b53856b-0d87-48ad-9f5c-80c765d656a8" released by "delete_volume" :: held 0.937s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Created reservations ['462baccb-524b-47bf-bf7a-a7315bf5f626', 'c51525fc-97ba-47fe-a7d1-09a2c643b85f', '33db8fe4-5ac2-4a26-9d86-6d34bfdac617', 'fb92fe31-d631-4c62-b619-41acea8ae974'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:53 devstack sudo[86323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:09:53 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-5b5ecc1e-f808-427c-b5cd-9394c864146f-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-5b5ecc1e-f808-427c-b5cd-9394c864146f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "cinder-quobyte-5b5ecc1e-f808-427c-b5cd-9394c864146f" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-5b5ecc1e-f808-427c-b5cd-9394c864146f" acquired by "delete_volume" :: waited 0.019s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[77739642-a97b-47d7-a03d-e2349ac35e72]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:53 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.428s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:09:53 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Deleted volume successfully. Feb 26 03:09:53 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f Feb 26 03:09:53 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-50fdfa93-5d64-4276-8063-92d5dd2ce9d1 tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-2b53856b-0d87-48ad-9f5c-80c765d656a8-delete_volume" released by "delete_volume" :: held 3.485s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:53 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f" returned: 0 in 0.503s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:53 devstack sudo[86331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f Feb 26 03:09:53 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:54 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5b5ecc1e-f808-427c-b5cd-9394c864146f" returned: 0 in 0.403s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-quobyte-5b5ecc1e-f808-427c-b5cd-9394c864146f" released by "delete_volume" :: held 0.932s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Created reservations ['b6258246-1062-4968-99fb-c5df750cae74', '94f4fa2d-dfea-49f5-a3ad-876b3ce587e9', 'f2d7248a-ca93-4e2a-9db4-272f3e3e1bdb', '4f552706-36b5-4328-925e-844e87513a0a'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:54 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:09:54 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:54 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.453s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:09:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Deleted volume successfully. Feb 26 03:09:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-19376938-0a05-4140-b1cc-443bd3424eab tempest-VolumesDeleteCascade-279008029 None] Lock "cinder-5b5ecc1e-f808-427c-b5cd-9394c864146f-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Flow 'volume_create_manager' (66d53f68-9d14-4ed5-b91b-4640861aa814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b71e813-5177-4d4f-b062-1fa34b9784fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b71e813-5177-4d4f-b062-1fa34b9784fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-593625664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691f5e8a-c702-48dd-8a27-e03783a8c50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a93b39574467d90249418ac40534b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:57Z,use_quota=True,user_id='562a3d9c7dd64ad0bbacceaaa912b615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04edcfdf-6ff5-4829-ba49-e8584218b54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04edcfdf-6ff5-4829-ba49-e8584218b54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181591c6-1a48-487e-a734-1fe27a9f3a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181591c6-1a48-487e-a734-1fe27a9f3a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691f5e8a-c702-48dd-8a27-e03783a8c50f', 'volume_name': 'volume-691f5e8a-c702-48dd-8a27-e03783a8c50f', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3e184d-a728-4f8e-b096-086df0ea2057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3e184d-a728-4f8e-b096-086df0ea2057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e015fb4a-ed17-486f-ae0e-d5fdc59f262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:57 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Volume 691f5e8a-c702-48dd-8a27-e03783a8c50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691f5e8a-c702-48dd-8a27-e03783a8c50f', 'volume_size': 1} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-593625664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691f5e8a-c702-48dd-8a27-e03783a8c50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a93b39574467d90249418ac40534b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:09:57Z,use_quota=True,user_id='562a3d9c7dd64ad0bbacceaaa912b615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Creating volume 691f5e8a-c702-48dd-8a27-e03783a8c50f {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:09:57 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:57 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f 1073741824 Feb 26 03:09:57 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:57 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f 1073741824" returned: 0 in 0.575s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:09:57 devstack sudo[86356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f Feb 26 03:09:57 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:09:58 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root Feb 26 03:09:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f" returned: 0 in 0.416s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:09:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:09:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:09:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e015fb4a-ed17-486f-ae0e-d5fdc59f262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691f5e8a-c702-48dd-8a27-e03783a8c50f', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d075dcb3-5015-40b1-85d1-0966685d5315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:09:58 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Volume volume-691f5e8a-c702-48dd-8a27-e03783a8c50f (691f5e8a-c702-48dd-8a27-e03783a8c50f): created successfully Feb 26 03:09:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d075dcb3-5015-40b1-85d1-0966685d5315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:09:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Flow 'volume_create_manager' (66d53f68-9d14-4ed5-b91b-4640861aa814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:09:58 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-dd7fc954-0478-47d7-aa5e-17d17c569f70 tempest-VolumesTransfersV355Test-1881621594 None] Created volume successfully. Feb 26 03:09:59 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-309f4d0d-55ec-4ca3-b5d7-7462889fa2d0 tempest-VolumesTransfersV355Test-1572449533 None] Transfer volume completed successfully. Feb 26 03:10:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Acquiring lock "cinder-691f5e8a-c702-48dd-8a27-e03783a8c50f-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Lock "cinder-691f5e8a-c702-48dd-8a27-e03783a8c50f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Acquiring lock "cinder-quobyte-691f5e8a-c702-48dd-8a27-e03783a8c50f" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Lock "cinder-quobyte-691f5e8a-c702-48dd-8a27-e03783a8c50f" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:00 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[599e62d6-8587-489f-be5a-03ca02b0fcf0]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:00 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f Feb 26 03:10:00 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:00 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f" returned: 0 in 0.504s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:00 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f Feb 26 03:10:00 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:01 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-691f5e8a-c702-48dd-8a27-e03783a8c50f" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Lock "cinder-quobyte-691f5e8a-c702-48dd-8a27-e03783a8c50f" released by "delete_volume" :: held 0.924s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Created reservations ['889273ce-6597-4319-9efd-dbc22b424f17', 'ec392813-ff32-49f5-9859-cde093453f69', '48492ade-3786-40e4-80e5-a6982a204f3f', 'd89c724d-e0d2-4950-9b09-9fa1c0a3508c'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:01 devstack sudo[86368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:10:01 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Flow 'volume_create_manager' (f8ae3ab1-c527-4eb2-a234-9e5a5ed3f351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9adef306-fb33-409b-8670-2023dbc640ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9adef306-fb33-409b-8670-2023dbc640ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-865415257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274a3c8b-8662-4089-a487-cbcb9a868d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a93b39574467d90249418ac40534b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:02Z,use_quota=True,user_id='562a3d9c7dd64ad0bbacceaaa912b615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6918031-211b-47fa-8165-448afde1afe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6918031-211b-47fa-8165-448afde1afe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971fa775-9ac9-4f0f-847d-92048ad45426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971fa775-9ac9-4f0f-847d-92048ad45426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274a3c8b-8662-4089-a487-cbcb9a868d09', 'volume_name': 'volume-274a3c8b-8662-4089-a487-cbcb9a868d09', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721865d0-8637-48d1-9901-3b0c4b1c1ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721865d0-8637-48d1-9901-3b0c4b1c1ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfc9d14-e4b7-4f44-9154-8562d0503845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:01 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Volume 274a3c8b-8662-4089-a487-cbcb9a868d09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274a3c8b-8662-4089-a487-cbcb9a868d09', 'volume_size': 1} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-865415257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274a3c8b-8662-4089-a487-cbcb9a868d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a93b39574467d90249418ac40534b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:02Z,use_quota=True,user_id='562a3d9c7dd64ad0bbacceaaa912b615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Creating volume 274a3c8b-8662-4089-a487-cbcb9a868d09 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:10:01 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:01 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09 1073741824 Feb 26 03:10:01 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:01 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.446s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:10:01 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Deleted volume successfully. Feb 26 03:10:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-563c25d4-d152-4c01-a7d6-d13ab8716d33 tempest-VolumesTransfersV355Test-2057003323 None] Lock "cinder-691f5e8a-c702-48dd-8a27-e03783a8c50f-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:02 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09 1073741824" returned: 0 in 0.490s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:02 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09 Feb 26 03:10:02 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:02 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09" returned: 0 in 0.397s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:02 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:10:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:02 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfc9d14-e4b7-4f44-9154-8562d0503845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274a3c8b-8662-4089-a487-cbcb9a868d09', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:02 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b4c433-8817-465b-8dc2-1995efe5ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:02 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Volume volume-274a3c8b-8662-4089-a487-cbcb9a868d09 (274a3c8b-8662-4089-a487-cbcb9a868d09): created successfully Feb 26 03:10:02 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b4c433-8817-465b-8dc2-1995efe5ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:02 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Flow 'volume_create_manager' (f8ae3ab1-c527-4eb2-a234-9e5a5ed3f351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:02 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5a6a0ffc-559c-48ec-8004-6cfdfd2e9805 tempest-VolumesTransfersV355Test-1881621594 None] Created volume successfully. Feb 26 03:10:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Acquiring lock "cinder-274a3c8b-8662-4089-a487-cbcb9a868d09-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Lock "cinder-274a3c8b-8662-4089-a487-cbcb9a868d09-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Acquiring lock "cinder-quobyte-274a3c8b-8662-4089-a487-cbcb9a868d09" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Lock "cinder-quobyte-274a3c8b-8662-4089-a487-cbcb9a868d09" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:03 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4ba6ba-25f8-424f-86e6-e489b5f65e92]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:04 devstack sudo[86381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09 Feb 26 03:10:04 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:04 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09" returned: 0 in 0.507s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:04 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09 Feb 26 03:10:04 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:04 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-274a3c8b-8662-4089-a487-cbcb9a868d09" returned: 0 in 0.384s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Lock "cinder-quobyte-274a3c8b-8662-4089-a487-cbcb9a868d09" released by "delete_volume" :: held 0.912s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Created reservations ['e89596f1-bb46-4b60-a01d-b7ee280a2fc0', '1268798f-600f-4ff3-b58c-73b5266cb1c5', 'eab6ac3e-6e1b-41ec-83ff-18bb67bccbe2', 'f84470dd-6df7-4da1-af58-13b1cc52416e'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:04 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:10:04 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:05 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:05 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:10:05 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Deleted volume successfully. Feb 26 03:10:05 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-caf10565-f451-4111-9471-daf14d2b6cec tempest-VolumesTransfersV355Test-2057003323 None] Lock "cinder-274a3c8b-8662-4089-a487-cbcb9a868d09-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Flow 'volume_create_manager' (ef05cedf-dc30-4f03-a12c-5d655c5c109f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e5b6e3-7178-4218-a763-104b48f2b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e5b6e3-7178-4218-a763-104b48f2b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-803130162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92cef8b-7aaf-4f69-a8c7-71d33c48993c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e3e781e4e74f1ab1f0b1045964bbfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:08Z,use_quota=True,user_id='3245d924400d4ab8a3b8bf892d03d8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f9ccc8-14e9-439b-8ecc-fab5eb662ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f9ccc8-14e9-439b-8ecc-fab5eb662ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d30dbc6-a127-4102-80da-bf945f305e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.image.glance [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Creating Keystone auth plugin from conf {{(pid=83121) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d30dbc6-a127-4102-80da-bf945f305e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f92cef8b-7aaf-4f69-a8c7-71d33c48993c', 'volume_name': 'volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d928e9-1402-4ddb-ab3b-32ac1b131363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d928e9-1402-4ddb-ab3b-32ac1b131363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f3d2e4-0ad8-4bc7-aed9-6480a21116e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:08 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Volume f92cef8b-7aaf-4f69-a8c7-71d33c48993c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Trying to clone f92cef8b-7aaf-4f69-a8c7-71d33c48993c from image 95c0faf7-23d7-4587-ab20-846f22462e10 at location (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]). {{(pid=83121) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 26 03:10:08 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Image download 20.69 MB at 20.69 MB/s Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6502a0f5-a446-4e0b-985c-c2d6ef31990c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:08 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD Feb 26 03:10:08 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:09 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Temporary image 95c0faf7-23d7-4587-ab20-846f22462e10 is fetched for user 3245d924400d4ab8a3b8bf892d03d8a9. {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9291ca-345f-4f8d-8f87-11f1d5fa6860]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:09 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD Feb 26 03:10:09 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:09 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD" returned: 0 in 0.458s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-803130162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92cef8b-7aaf-4f69-a8c7-71d33c48993c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e3e781e4e74f1ab1f0b1045964bbfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:08Z,use_quota=True,user_id='3245d924400d4ab8a3b8bf892d03d8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Creating volume f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:10:09 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:10:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:09 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c 1073741824 Feb 26 03:10:09 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:10 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c 1073741824" returned: 0 in 0.489s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:10 devstack sudo[86448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c Feb 26 03:10:10 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:10 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" returned: 0 in 0.439s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:10:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:10 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Attempting download of 95c0faf7-23d7-4587-ab20-846f22462e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}])) to volume f92cef8b-7aaf-4f69-a8c7-71d33c48993c. {{(pid=83121) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 26 03:10:10 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[457be06f-3dba-4a4c-bd89-fcc94f2692b7]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_x5xk4gcs {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:10 devstack sudo[86451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_x5xk4gcs Feb 26 03:10:10 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:11 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_x5xk4gcs" returned: 0 in 0.445s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_x5xk4gcs {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:11 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_x5xk4gcs Feb 26 03:10:11 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:11 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_x5xk4gcs" returned: 1 in 0.460s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_x5xk4gcs' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:10:11 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d8929f-685f-4496-9390-4330694adc8f]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:11 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD Feb 26 03:10:11 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:12 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:12 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] 95c0faf7-23d7-4587-ab20-846f22462e10 was qcow2, converting to raw {{(pid=83121) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 26 03:10:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:12 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c Feb 26 03:10:12 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:12 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" returned: 0 in 0.869s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:12 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_cncowxp6devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:10:12 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Converted 112.00 MB image at 112.00 MB/s Feb 26 03:10:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:12 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c 1G Feb 26 03:10:12 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:13 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c 1G" returned: 0 in 0.412s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:13 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[332a8ac6-c621-4979-9c6b-f82fff96c138]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:13 devstack sudo[86486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c Feb 26 03:10:13 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:13 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" returned: 0 in 0.469s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:13 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c Feb 26 03:10:13 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:14 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" returned: 1 in 0.471s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Downloaded image 95c0faf7-23d7-4587-ab20-846f22462e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}])) to volume f92cef8b-7aaf-4f69-a8c7-71d33c48993c successfully. {{(pid=83121) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Temporary image 95c0faf7-23d7-4587-ab20-846f22462e10 for user 3245d924400d4ab8a3b8bf892d03d8a9 is deleted. {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Marking volume f92cef8b-7aaf-4f69-a8c7-71d33c48993c as bootable. {{(pid=83121) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Copying metadata from image 95c0faf7-23d7-4587-ab20-846f22462e10 to f92cef8b-7aaf-4f69-a8c7-71d33c48993c. {{(pid=83121) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Creating volume glance metadata for volume f92cef8b-7aaf-4f69-a8c7-71d33c48993c backed by image 95c0faf7-23d7-4587-ab20-846f22462e10 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83121) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f3d2e4-0ad8-4bc7-aed9-6480a21116e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82cf411-baaf-4f33-88da-2e975e6b73d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:14 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Volume volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c (f92cef8b-7aaf-4f69-a8c7-71d33c48993c): created successfully Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82cf411-baaf-4f33-88da-2e975e6b73d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Flow 'volume_create_manager' (ef05cedf-dc30-4f03-a12c-5d655c5c109f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:14 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-529e910f-9615-457c-aa03-ecc9a34b5fcd tempest-VolumesExtendTest-60575155 None] Created volume successfully. Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aafdbf6-e313-42b8-ac2e-bf9c9cff73c1]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:14 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c Feb 26 03:10:14 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:15 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" returned: 0 in 0.460s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:15 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c Feb 26 03:10:15 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:15 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" returned: 1 in 0.460s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c 2G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c 2G" returned: 0 in 0.033s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.981s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:15 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-99ab440a-bb9b-4d2f-9384-1a1a70d691d8 tempest-VolumesExtendTest-60575155 None] Extend volume completed successfully. Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Acquiring lock "cinder-f92cef8b-7aaf-4f69-a8c7-71d33c48993c-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Lock "cinder-f92cef8b-7aaf-4f69-a8c7-71d33c48993c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Acquiring lock "cinder-quobyte-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Lock "cinder-quobyte-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:16 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9e2f94-19ee-4b2f-922e-df0ef4974981]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:16 devstack sudo[86507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c Feb 26 03:10:16 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:16 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" returned: 0 in 0.470s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:16 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c Feb 26 03:10:16 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:16 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" returned: 1 in 0.446s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:10:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:16 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c Feb 26 03:10:16 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:17 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" returned: 0 in 0.422s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Lock "cinder-quobyte-f92cef8b-7aaf-4f69-a8c7-71d33c48993c" released by "delete_volume" :: held 1.383s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Created reservations ['5d0bac56-a980-4989-94ad-245f4b78b76e', 'b5e2a1bc-d00a-406b-a602-96da517efa52', '2caa544e-c070-4b63-ae05-a2b680ebf27b', '01fdd3c4-1301-4c39-a078-c75313a44c1d'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:17 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:10:17 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:17 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.399s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:10:17 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Deleted volume successfully. Feb 26 03:10:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-03a31804-f693-4b9e-b9ab-1dd5512d4f00 tempest-VolumesExtendTest-60575155 None] Lock "cinder-f92cef8b-7aaf-4f69-a8c7-71d33c48993c-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Flow 'volume_create_manager' (bb8d6998-08b4-48b7-abbc-39fd1f121c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb15fda-4836-43d7-acf3-e92b4693888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb15fda-4836-43d7-acf3-e92b4693888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-313459653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81da5c8-08ed-413d-9f4b-e9914a218f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e3e781e4e74f1ab1f0b1045964bbfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:18Z,use_quota=True,user_id='3245d924400d4ab8a3b8bf892d03d8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8eee7d-4351-4499-9150-246b6c12ecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8eee7d-4351-4499-9150-246b6c12ecaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d15317-a545-4c1a-9955-11f521a55c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d15317-a545-4c1a-9955-11f521a55c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81da5c8-08ed-413d-9f4b-e9914a218f4e', 'volume_name': 'volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1c7176-b968-47fc-a52d-ea74c979fc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1c7176-b968-47fc-a52d-ea74c979fc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1428accf-0a5a-434e-83c6-8e1803c43626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:18 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Volume d81da5c8-08ed-413d-9f4b-e9914a218f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e', 'volume_size': 1} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-313459653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81da5c8-08ed-413d-9f4b-e9914a218f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e3e781e4e74f1ab1f0b1045964bbfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:18Z,use_quota=True,user_id='3245d924400d4ab8a3b8bf892d03d8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Creating volume d81da5c8-08ed-413d-9f4b-e9914a218f4e {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:10:18 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:18 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e 1073741824 Feb 26 03:10:18 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:18 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e 1073741824" returned: 0 in 0.491s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:18 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e Feb 26 03:10:18 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:19 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e" returned: 0 in 0.394s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:10:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1428accf-0a5a-434e-83c6-8e1803c43626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d9f5bb-1324-4717-98d0-c607890b3b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:19 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Volume volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e (d81da5c8-08ed-413d-9f4b-e9914a218f4e): created successfully Feb 26 03:10:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d9f5bb-1324-4717-98d0-c607890b3b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Flow 'volume_create_manager' (bb8d6998-08b4-48b7-abbc-39fd1f121c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:19 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6b61e0d0-cb76-4780-b7f6-21439ec92a04 tempest-VolumesExtendTest-60575155 None] Created volume successfully. Feb 26 03:10:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Creating offline snapshot df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 of volume d81da5c8-08ed-413d-9f4b-e9914a218f4e {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:10:20 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e97c467-60be-40d4-a20b-1829dbd30844]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:20 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e Feb 26 03:10:20 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:21 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e" returned: 0 in 0.495s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:21 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 1G Feb 26 03:10:21 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:21 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 1G" returned: 0 in 0.444s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:21 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 Feb 26 03:10:21 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:21 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55" returned: 0 in 0.422s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:21 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 is being set with open permissions: ugo+rw Feb 26 03:10:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:21 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 Feb 26 03:10:21 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:22 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55" returned: 0 in 0.412s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:22 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.info Feb 26 03:10:22 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:22 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.info" returned: 0 in 0.406s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:22 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.info is being set with open permissions: ugo+rw Feb 26 03:10:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:22 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.info Feb 26 03:10:22 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:23 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.info" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.628s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:23 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-23f42233-0764-48a3-9295-91e02740762d tempest-VolumesExtendTest-60575155 None] Create snapshot completed successfully Feb 26 03:10:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e3770c40-48b9-4332-a1d8-629d2b08777e tempest-VolumesExtendTest-60575155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e3770c40-48b9-4332-a1d8-629d2b08777e tempest-VolumesExtendTest-60575155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:23 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14cc7d1-4740-4c8d-9997-7f3cea8b0887]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e3770c40-48b9-4332-a1d8-629d2b08777e tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:23 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e Feb 26 03:10:23 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:24 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e3770c40-48b9-4332-a1d8-629d2b08777e tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e" returned: 0 in 0.481s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e3770c40-48b9-4332-a1d8-629d2b08777e tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 2G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e3770c40-48b9-4332-a1d8-629d2b08777e tempest-VolumesExtendTest-60575155 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 2G" returned: 0 in 0.081s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e3770c40-48b9-4332-a1d8-629d2b08777e tempest-VolumesExtendTest-60575155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.577s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e3770c40-48b9-4332-a1d8-629d2b08777e tempest-VolumesExtendTest-60575155 None] Extend volume completed successfully. Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Acquiring lock "cinder-df80ce1d-efeb-4f7c-8aab-7be7b6d26b55-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Lock "cinder-df80ce1d-efeb-4f7c-8aab-7be7b6d26b55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Acquiring lock "cinder-quobyte-d81da5c8-08ed-413d-9f4b-e9914a218f4e" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Lock "cinder-quobyte-d81da5c8-08ed-413d-9f4b-e9914a218f4e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Acquiring lock "cinder-quobyte-df80ce1d-efeb-4f7c-8aab-7be7b6d26b55" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Lock "cinder-quobyte-df80ce1d-efeb-4f7c-8aab-7be7b6d26b55" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Deleting offline snapshot df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 of volume d81da5c8-08ed-413d-9f4b-e9914a218f4e {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] snapshot_file for this snap is: volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7d22e7-5234-4113-945e-7911956ea8cf]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:24 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 Feb 26 03:10:24 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:25 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55" returned: 0 in 0.473s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:10:25 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[279f4ab9-9aa0-4d3d-8175-4cc0c06a9a62]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:25 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e Feb 26 03:10:25 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:25 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e" returned: 0 in 0.459s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:25 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 Feb 26 03:10:25 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:26 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:26 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55 Feb 26 03:10:26 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:26 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e.df80ce1d-efeb-4f7c-8aab-7be7b6d26b55" returned: 0 in 0.401s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Lock "cinder-quobyte-df80ce1d-efeb-4f7c-8aab-7be7b6d26b55" released by "_delete_snapshot" :: held 1.841s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Lock "cinder-quobyte-d81da5c8-08ed-413d-9f4b-e9914a218f4e" released by "delete_snapshot" :: held 1.852s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:26 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Created reservations ['4262b622-519c-49af-b73e-e74144bb71b0', '381429e9-9fe1-4de9-b280-279f1064a9e7', '6cdef766-a3a0-44e0-b421-02ab808f4ad3', '6bf06ab1-fdd6-407d-82f2-9db18a2f93f2'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:10:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Delete snapshot completed successfully. Feb 26 03:10:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e20eec58-ef41-4cce-bd1b-51d82963ef7f tempest-VolumesExtendTest-60575155 None] Lock "cinder-df80ce1d-efeb-4f7c-8aab-7be7b6d26b55-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Acquiring lock "cinder-d81da5c8-08ed-413d-9f4b-e9914a218f4e-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Lock "cinder-d81da5c8-08ed-413d-9f4b-e9914a218f4e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Acquiring lock "cinder-quobyte-d81da5c8-08ed-413d-9f4b-e9914a218f4e" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Lock "cinder-quobyte-d81da5c8-08ed-413d-9f4b-e9914a218f4e" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:27 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5c5302-d707-4a56-8a5d-856435bcb83f]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:27 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e Feb 26 03:10:27 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:27 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e" returned: 0 in 0.486s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:27 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e Feb 26 03:10:27 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:27 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d81da5c8-08ed-413d-9f4b-e9914a218f4e" returned: 0 in 0.416s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Lock "cinder-quobyte-d81da5c8-08ed-413d-9f4b-e9914a218f4e" released by "delete_volume" :: held 0.935s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:28 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Created reservations ['48970769-e55e-4aa9-8986-cc8109505704', '23d351ca-6746-480c-9c31-e21cabd54a2a', 'deb22531-2ee3-4f13-8100-ea7b70943950', '1c239ada-2820-4d4d-ade5-3aa6208b05f8'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:10:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:28 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:10:28 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:28 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.449s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:28 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:10:28 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Deleted volume successfully. Feb 26 03:10:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5b85293a-0ed8-4da6-8bf6-9651b7f95f6c tempest-VolumesExtendTest-60575155 None] Lock "cinder-d81da5c8-08ed-413d-9f4b-e9914a218f4e-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (f5f6b39a-dec8-4d73-9d93-70e1b4711549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddf8142-0e39-4efb-b4b0-99303047062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddf8142-0e39-4efb-b4b0-99303047062b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1983440554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351a0dd3-4efc-4064-8a66-10b780d2d22e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:30Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196f7cdb-f7f9-4e4a-8648-0aeebcb07f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196f7cdb-f7f9-4e4a-8648-0aeebcb07f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a9283c-9671-4e56-9fef-0f8afaf3a985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a9283c-9671-4e56-9fef-0f8afaf3a985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '351a0dd3-4efc-4064-8a66-10b780d2d22e', 'volume_name': 'volume-351a0dd3-4efc-4064-8a66-10b780d2d22e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bbff2c-dfac-4a3e-824a-0bccce9a9e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bbff2c-dfac-4a3e-824a-0bccce9a9e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1bd46a4-381b-44b8-8587-51cbf0508ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:29 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Volume 351a0dd3-4efc-4064-8a66-10b780d2d22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-351a0dd3-4efc-4064-8a66-10b780d2d22e', 'volume_size': 1} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1983440554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351a0dd3-4efc-4064-8a66-10b780d2d22e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:30Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Creating volume 351a0dd3-4efc-4064-8a66-10b780d2d22e {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:10:29 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:10:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:29 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e 1073741824 Feb 26 03:10:29 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:30 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e 1073741824" returned: 0 in 0.476s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:30 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e Feb 26 03:10:30 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:30 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e" returned: 0 in 0.407s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:10:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1bd46a4-381b-44b8-8587-51cbf0508ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-351a0dd3-4efc-4064-8a66-10b780d2d22e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc44552-068e-4f34-aeea-30f1c2e2ff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:30 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Volume volume-351a0dd3-4efc-4064-8a66-10b780d2d22e (351a0dd3-4efc-4064-8a66-10b780d2d22e): created successfully Feb 26 03:10:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc44552-068e-4f34-aeea-30f1c2e2ff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (f5f6b39a-dec8-4d73-9d93-70e1b4711549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:30 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6cba7e17-5cb5-4bc2-a236-803f41b6cae1 tempest-VolumesGetTest-279259075 None] Created volume successfully. Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (6be7b78b-5e8e-4ade-9030-444063002271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3bc218-89c2-4a4b-ae08-c12bfb9c39f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3bc218-89c2-4a4b-ae08-c12bfb9c39f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1511911566',display_name='tempest-VolumesGetTest-Volume-1142765138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cec7153-ffa2-41a8-928a-4fa59839d57a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:31Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ef94dd-ee8b-4706-9a75-eeef921c9ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ef94dd-ee8b-4706-9a75-eeef921c9ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b465b88e-87ee-49a2-bc03-955c809eae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b465b88e-87ee-49a2-bc03-955c809eae97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cec7153-ffa2-41a8-928a-4fa59839d57a', 'volume_name': 'volume-2cec7153-ffa2-41a8-928a-4fa59839d57a', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a20aea-573f-4379-9663-170f1395d362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a20aea-573f-4379-9663-170f1395d362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9ce578-2be6-45c5-8266-28f22675226f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:31 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Volume 2cec7153-ffa2-41a8-928a-4fa59839d57a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cec7153-ffa2-41a8-928a-4fa59839d57a', 'volume_size': 1} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1511911566',display_name='tempest-VolumesGetTest-Volume-1142765138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cec7153-ffa2-41a8-928a-4fa59839d57a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:31Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Creating volume 2cec7153-ffa2-41a8-928a-4fa59839d57a {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:10:31 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:31 devstack sudo[86605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a 1073741824 Feb 26 03:10:31 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:31 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a 1073741824" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:31 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a Feb 26 03:10:31 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:32 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:10:32 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:32 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a" returned: 0 in 0.389s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9ce578-2be6-45c5-8266-28f22675226f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cec7153-ffa2-41a8-928a-4fa59839d57a', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c9e0bd-9600-4bc4-bc4f-d58b0986ee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:32 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Volume volume-2cec7153-ffa2-41a8-928a-4fa59839d57a (2cec7153-ffa2-41a8-928a-4fa59839d57a): created successfully Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c9e0bd-9600-4bc4-bc4f-d58b0986ee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (6be7b78b-5e8e-4ade-9030-444063002271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:32 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-7a610817-b5e1-4065-81e3-35bf42378cef tempest-VolumesGetTest-279259075 None] Created volume successfully. Feb 26 03:10:32 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.445s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:10:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-2cec7153-ffa2-41a8-928a-4fa59839d57a-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Lock "cinder-2cec7153-ffa2-41a8-928a-4fa59839d57a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-quobyte-2cec7153-ffa2-41a8-928a-4fa59839d57a" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-2cec7153-ffa2-41a8-928a-4fa59839d57a" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[540f5614-7568-41a3-9295-0941e7b98de3]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:33 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a Feb 26 03:10:33 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:33 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a" returned: 0 in 0.487s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:33 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a Feb 26 03:10:33 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:34 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2cec7153-ffa2-41a8-928a-4fa59839d57a" returned: 0 in 0.416s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-2cec7153-ffa2-41a8-928a-4fa59839d57a" released by "delete_volume" :: held 0.924s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Created reservations ['c78acb30-c6f9-47fc-8d3f-a73d7e14ab60', '55b67dc8-2c27-4f9d-9b72-2148b6fe32b9', 'fcddf753-8e32-4c80-a092-91fae39cbc9a', '010ddd0a-b706-4496-8aea-96650536441f'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:34 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:10:34 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-351a0dd3-4efc-4064-8a66-10b780d2d22e-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Lock "cinder-351a0dd3-4efc-4064-8a66-10b780d2d22e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-quobyte-351a0dd3-4efc-4064-8a66-10b780d2d22e" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-351a0dd3-4efc-4064-8a66-10b780d2d22e" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[311f4ad5-6404-44bb-81e2-216b13ec2561]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:34 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e Feb 26 03:10:34 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:34 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.427s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:10:34 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Deleted volume successfully. Feb 26 03:10:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-959241e8-6104-422b-b365-2387c9db6079 tempest-VolumesGetTest-279259075 None] Lock "cinder-2cec7153-ffa2-41a8-928a-4fa59839d57a-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:35 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:35 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e Feb 26 03:10:35 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:35 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-351a0dd3-4efc-4064-8a66-10b780d2d22e" returned: 0 in 0.414s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-351a0dd3-4efc-4064-8a66-10b780d2d22e" released by "delete_volume" :: held 0.915s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Created reservations ['ed768e4f-9c55-4c96-b59d-c62e4cbe0fda', '8ab1c71d-8431-4c83-9e50-0834e8dc4461', 'c0d1430c-6c58-4bbf-86b7-7a4ed8724b0f', 'f2e82dde-e5bb-4a90-9610-43102cd44b2b'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:35 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:10:35 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (e0c45b58-dc2a-4032-844a-9593002de476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcb91f1-b3e2-45d9-8680-4231a49cd215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcb91f1-b3e2-45d9-8680-4231a49cd215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-828353503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe587f8-9de1-4d59-a1f5-a75d34e88114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:36Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9c6515-4864-471f-a678-262d671cdfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9c6515-4864-471f-a678-262d671cdfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b186ebd7-98d0-4e44-90db-01c91946b49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b186ebd7-98d0-4e44-90db-01c91946b49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe587f8-9de1-4d59-a1f5-a75d34e88114', 'volume_name': 'volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e58d0-f1b9-4c2d-941c-7bf1fbcea8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e58d0-f1b9-4c2d-941c-7bf1fbcea8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfd6172-9a92-4553-9ff0-a6c40201dc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:35 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Volume 5fe587f8-9de1-4d59-a1f5-a75d34e88114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114', 'volume_size': 1} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-828353503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe587f8-9de1-4d59-a1f5-a75d34e88114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:36Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Creating volume 5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:10:35 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:10:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:35 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 1073741824 Feb 26 03:10:35 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:36 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.452s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:10:36 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Deleted volume successfully. Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-881e9897-9d9f-41ee-a455-858ed354e958 tempest-VolumesGetTest-279259075 None] Lock "cinder-351a0dd3-4efc-4064-8a66-10b780d2d22e-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:36 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 1073741824" returned: 0 in 0.495s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:36 devstack sudo[86643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 Feb 26 03:10:36 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:36 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfd6172-9a92-4553-9ff0-a6c40201dc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6e52cf-93d2-4813-b0d9-803432289711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:36 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Volume volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 (5fe587f8-9de1-4d59-a1f5-a75d34e88114): created successfully Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6e52cf-93d2-4813-b0d9-803432289711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (e0c45b58-dc2a-4032-844a-9593002de476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:36 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-1a0cdf43-50af-4d96-9c66-face3b109f0b tempest-VolumesGetTest-279259075 None] Created volume successfully. Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (79ca1a94-5846-4bd5-aea3-6d85782f5d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1caad7-23da-495a-a637-ed3c652144cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1caad7-23da-495a-a637-ed3c652144cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-78664660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b107d8a-9276-4ddc-9585-e1138575310c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5fe587f8-9de1-4d59-a1f5-a75d34e88114,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:38Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66b10b5-6aa3-43df-a900-d557632f30de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66b10b5-6aa3-43df-a900-d557632f30de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cf95ec-f017-4782-975d-e30999a295d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cf95ec-f017-4782-975d-e30999a295d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2b107d8a-9276-4ddc-9585-e1138575310c', 'volume_name': 'volume-2b107d8a-9276-4ddc-9585-e1138575310c', 'volume_size': 1, 'source_volid': '5fe587f8-9de1-4d59-a1f5-a75d34e88114', 'source_volstatus': 'available'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4c012e-eb6f-4d98-973e-8326317cc44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4c012e-eb6f-4d98-973e-8326317cc44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9256c9-40c3-42ac-b631-60c22396ad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:38 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Volume 2b107d8a-9276-4ddc-9585-e1138575310c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2b107d8a-9276-4ddc-9585-e1138575310c', 'volume_size': 1, 'source_volid': '5fe587f8-9de1-4d59-a1f5-a75d34e88114', 'source_volstatus': 'available'} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:38 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Cloning volume 5fe587f8-9de1-4d59-a1f5-a75d34e88114 to volume 2b107d8a-9276-4ddc-9585-e1138575310c Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Creating offline snapshot 3852baa7-e864-42fb-aec2-d47f7a26dc35 of volume 5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a42e40d-21eb-40fb-93aa-369f39bf23bf]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:38 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 Feb 26 03:10:38 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:38 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:38 devstack sudo[86651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 1G Feb 26 03:10:38 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:39 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 1G" returned: 0 in 0.473s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:39 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 Feb 26 03:10:39 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:39 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35" returned: 0 in 0.417s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:39 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 is being set with open permissions: ugo+rw Feb 26 03:10:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:39 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 Feb 26 03:10:39 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:40 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35" returned: 0 in 0.429s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:40 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.info Feb 26 03:10:40 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:40 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.info" returned: 0 in 0.411s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:40 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.info is being set with open permissions: ugo+rw Feb 26 03:10:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:40 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.info Feb 26 03:10:40 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:40 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.info" returned: 0 in 0.411s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-quobyte-2b107d8a-9276-4ddc-9585-e1138575310c" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-2b107d8a-9276-4ddc-9585-e1138575310c" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] snapshot: 3852baa7-e864-42fb-aec2-d47f7a26dc35, volume: 2b107d8a-9276-4ddc-9585-e1138575310c, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[be190a69-93c8-4792-85da-f0fd3272f2cb]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:41 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 Feb 26 03:10:41 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:41 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35" returned: 0 in 0.466s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce037794-e5b5-4a96-93a7-df0628580320]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:41 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 Feb 26 03:10:41 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:41 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114" returned: 0 in 0.475s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:10:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:41 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c Feb 26 03:10:41 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:44 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c" returned: 0 in 2.028s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:44 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[123214e0-a8f9-4ee3-8ec6-cb83785a8009]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:44 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 Feb 26 03:10:44 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:44 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114" returned: 0 in 0.599s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:44 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:10:44 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Converted 1024.00 MB image at 504.56 MB/s Feb 26 03:10:44 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c is being set with open permissions: ugo+rw Feb 26 03:10:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:44 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c Feb 26 03:10:44 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:45 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c" returned: 0 in 0.405s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-2b107d8a-9276-4ddc-9585-e1138575310c" released by "_copy_volume_from_snapshot" :: held 4.015s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-quobyte-3852baa7-e864-42fb-aec2-d47f7a26dc35" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-3852baa7-e864-42fb-aec2-d47f7a26dc35" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Deleting offline snapshot 3852baa7-e864-42fb-aec2-d47f7a26dc35 of volume 5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] snapshot_file for this snap is: volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e6d6ad-829c-485c-8c85-f40f819e11a0]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:45 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 Feb 26 03:10:45 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35" returned: 0 in 0.465s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:10:45 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3b6d3f-b771-4413-bfed-87fc9f8fd28d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:45 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 Feb 26 03:10:45 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:46 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114" returned: 0 in 0.482s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:46 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 Feb 26 03:10:46 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:46 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35" returned: 0 in 0.421s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:46 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35 Feb 26 03:10:46 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:46 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114.3852baa7-e864-42fb-aec2-d47f7a26dc35" returned: 0 in 0.414s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-3852baa7-e864-42fb-aec2-d47f7a26dc35" released by "_delete_snapshot" :: held 1.828s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.567s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9256c9-40c3-42ac-b631-60c22396ad8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b107d8a-9276-4ddc-9585-e1138575310c', 'volume_size': 1, 'source_volid': '5fe587f8-9de1-4d59-a1f5-a75d34e88114', 'source_volstatus': 'available'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464c4a06-ed74-484e-b203-d0f978e0f51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:46 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Volume volume-2b107d8a-9276-4ddc-9585-e1138575310c (2b107d8a-9276-4ddc-9585-e1138575310c): created successfully Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464c4a06-ed74-484e-b203-d0f978e0f51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (79ca1a94-5846-4bd5-aea3-6d85782f5d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:46 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f2e51a10-113a-49b9-9cb5-bb4ee9a6120b tempest-VolumesGetTest-279259075 None] Created volume successfully. Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (ffc58a4b-76ab-4be1-bf3d-ef536431cdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d092ca7-cbde-4951-96ee-60dcd90f1259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d092ca7-cbde-4951-96ee-60dcd90f1259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-34712189',display_name='tempest-VolumesGetTest-Volume-1433489783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afd16f3-53d9-4d51-9e86-feac5f7312cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:48Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2111e616-8ad8-4b85-bf05-1b79fd37b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2111e616-8ad8-4b85-bf05-1b79fd37b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313d08da-d335-4738-af63-49afca124003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313d08da-d335-4738-af63-49afca124003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8afd16f3-53d9-4d51-9e86-feac5f7312cc', 'volume_name': 'volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca892b6-5f94-491b-9fe8-41e82dc86307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca892b6-5f94-491b-9fe8-41e82dc86307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87df3cd0-d8ea-4c97-b358-3e9ff3d49f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:48 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Volume 8afd16f3-53d9-4d51-9e86-feac5f7312cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc', 'volume_size': 1} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-34712189',display_name='tempest-VolumesGetTest-Volume-1433489783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afd16f3-53d9-4d51-9e86-feac5f7312cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:48Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Creating volume 8afd16f3-53d9-4d51-9e86-feac5f7312cc {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:10:48 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:48 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc 1073741824 Feb 26 03:10:48 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:48 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc 1073741824" returned: 0 in 0.469s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:48 devstack sudo[86724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc Feb 26 03:10:48 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:49 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc" returned: 0 in 0.428s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:10:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:49 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=111,cinder:SELECT=98,cinder:INSERT=27,cinder:DELETE=4 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:10:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87df3cd0-d8ea-4c97-b358-3e9ff3d49f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50714f96-1811-4c33-b540-31d64292ddf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:49 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=113,cinder:DELETE=14,cinder:SELECT=75,cinder:INSERT=38 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:10:49 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Volume volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc (8afd16f3-53d9-4d51-9e86-feac5f7312cc): created successfully Feb 26 03:10:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50714f96-1811-4c33-b540-31d64292ddf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (ffc58a4b-76ab-4be1-bf3d-ef536431cdbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:49 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-31b4eedd-e450-45c0-bd8b-fb31e602e162 tempest-VolumesGetTest-279259075 None] Created volume successfully. Feb 26 03:10:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-8afd16f3-53d9-4d51-9e86-feac5f7312cc-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Lock "cinder-8afd16f3-53d9-4d51-9e86-feac5f7312cc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-quobyte-8afd16f3-53d9-4d51-9e86-feac5f7312cc" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-8afd16f3-53d9-4d51-9e86-feac5f7312cc" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:50 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d208995c-118e-4f28-b064-c91616f0d15b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:50 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc Feb 26 03:10:50 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:50 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc" returned: 0 in 0.476s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:50 devstack sudo[86732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc Feb 26 03:10:50 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:51 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8afd16f3-53d9-4d51-9e86-feac5f7312cc" returned: 0 in 0.404s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-8afd16f3-53d9-4d51-9e86-feac5f7312cc" released by "delete_volume" :: held 0.909s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Created reservations ['5eb540b8-9775-46fb-b0b4-171f47c7d7a4', '9a5bbbed-b72b-4c15-b072-fcf72301cc49', '8f1787a3-0b8b-49d2-a238-431c7402d74f', '70695cca-7aad-4414-84c2-ed6f0c740170'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:51 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:10:51 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-2b107d8a-9276-4ddc-9585-e1138575310c-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Lock "cinder-2b107d8a-9276-4ddc-9585-e1138575310c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-quobyte-2b107d8a-9276-4ddc-9585-e1138575310c" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-2b107d8a-9276-4ddc-9585-e1138575310c" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[65538831-fd2d-43d7-8471-cdb96db64c4a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:51 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c Feb 26 03:10:51 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:51 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.429s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:10:51 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Deleted volume successfully. Feb 26 03:10:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cd3d1fb3-5368-430c-8e29-86dd55b67e2d tempest-VolumesGetTest-279259075 None] Lock "cinder-8afd16f3-53d9-4d51-9e86-feac5f7312cc-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:52 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c" returned: 0 in 0.503s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:52 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c Feb 26 03:10:52 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:52 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b107d8a-9276-4ddc-9585-e1138575310c" returned: 0 in 0.403s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-2b107d8a-9276-4ddc-9585-e1138575310c" released by "delete_volume" :: held 0.933s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Created reservations ['53b81458-f80d-4966-a18b-9c9ac223465e', '51e77c17-9130-461d-bee2-8c8e47708d1d', '7adfde0a-e753-499c-aba7-1367eb704e4c', '58d1be6f-9d1d-4b12-b067-26b3a23069c0'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:52 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:10:52 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-5fe587f8-9de1-4d59-a1f5-a75d34e88114-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Lock "cinder-5fe587f8-9de1-4d59-a1f5-a75d34e88114-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-quobyte-5fe587f8-9de1-4d59-a1f5-a75d34e88114" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-5fe587f8-9de1-4d59-a1f5-a75d34e88114" acquired by "delete_volume" :: waited 0.018s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0130d3-788f-4acb-9505-4e25660b0ae9]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:52 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 Feb 26 03:10:52 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:52 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.437s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:10:52 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Deleted volume successfully. Feb 26 03:10:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5024842b-87dd-43b1-9c06-4991a3735bff tempest-VolumesGetTest-279259075 None] Lock "cinder-2b107d8a-9276-4ddc-9585-e1138575310c-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:53 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114" returned: 0 in 0.482s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:53 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114 Feb 26 03:10:53 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:53 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5fe587f8-9de1-4d59-a1f5-a75d34e88114" returned: 0 in 0.415s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-5fe587f8-9de1-4d59-a1f5-a75d34e88114" released by "delete_volume" :: held 0.921s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Created reservations ['25e3f3dc-1445-4b68-94e8-3bd4b3554208', '9af066c8-fe3d-4bd0-b70b-24bf0c352af7', 'cb1601d2-01d4-463b-a00a-7b71366f443d', '9f18dfbd-feb1-4026-94fe-72f5d60229a5'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:53 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:10:53 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:10:54 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (0c83ea4a-bc3f-4b6d-a78a-31be0f8e772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8016102-096a-484a-83e8-d0ed51f84edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8016102-096a-484a-83e8-d0ed51f84edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-392072501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da289082-34ee-448f-8996-16f5d6adc3dd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:54Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca36605a-16fa-4a21-afe6-22c4789492b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca36605a-16fa-4a21-afe6-22c4789492b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48b7bbd-6975-46b2-b569-3ee3da640577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.image.glance [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Creating Keystone auth plugin from conf {{(pid=83121) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.501s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:10:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Deleted volume successfully. Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4cb93bd8-4887-45df-80ea-e767b1ede42f tempest-VolumesGetTest-279259075 None] Lock "cinder-5fe587f8-9de1-4d59-a1f5-a75d34e88114-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48b7bbd-6975-46b2-b569-3ee3da640577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da289082-34ee-448f-8996-16f5d6adc3dd', 'volume_name': 'volume-da289082-34ee-448f-8996-16f5d6adc3dd', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89df692b-25cf-4c25-8459-2d3c391ce9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89df692b-25cf-4c25-8459-2d3c391ce9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c19b60-9099-452a-ae39-a995e1137ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:10:54 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Volume da289082-34ee-448f-8996-16f5d6adc3dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da289082-34ee-448f-8996-16f5d6adc3dd', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Trying to clone da289082-34ee-448f-8996-16f5d6adc3dd from image 95c0faf7-23d7-4587-ab20-846f22462e10 at location (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]). {{(pid=83121) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 26 03:10:54 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Image download 20.69 MB at 20.69 MB/s Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9ee32d-e041-4778-bc1f-9a8ba68b5bb1]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:54 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD Feb 26 03:10:54 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:55 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Temporary image 95c0faf7-23d7-4587-ab20-846f22462e10 is fetched for user be9686054c784dd293c5dd0062ac78e9. {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ecfac6-02eb-4c87-ae3d-67ad9b9cb299]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:55 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD Feb 26 03:10:55 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:55 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-392072501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da289082-34ee-448f-8996-16f5d6adc3dd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:10:54Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Creating volume da289082-34ee-448f-8996-16f5d6adc3dd {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:10:55 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:10:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:55 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd 1073741824 Feb 26 03:10:55 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:56 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd 1073741824" returned: 0 in 0.517s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:56 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd Feb 26 03:10:56 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:56 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd" returned: 0 in 0.474s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:56 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:10:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:10:56 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Attempting download of 95c0faf7-23d7-4587-ab20-846f22462e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}])) to volume da289082-34ee-448f-8996-16f5d6adc3dd. {{(pid=83121) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 26 03:10:56 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc0cf93-3259-49e7-b75b-4404651df55a]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10__5c_jdik {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:56 devstack sudo[86782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10__5c_jdik Feb 26 03:10:56 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:57 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10__5c_jdik" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10__5c_jdik {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:57 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10__5c_jdik Feb 26 03:10:57 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:57 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10__5c_jdik" returned: 1 in 0.526s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10__5c_jdik' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:10:57 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edb03d6-13b2-4c44-b69a-457bc584954c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:57 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD Feb 26 03:10:57 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:58 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:58 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] 95c0faf7-23d7-4587-ab20-846f22462e10 was qcow2, converting to raw {{(pid=83121) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 26 03:10:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:58 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd Feb 26 03:10:58 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:58 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd" returned: 0 in 0.852s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:58 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_38m5ygowdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:10:58 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Converted 112.00 MB image at 112.00 MB/s Feb 26 03:10:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:58 devstack sudo[86821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd 1G Feb 26 03:10:58 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:59 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd 1G" returned: 0 in 0.419s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:59 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e581c67-bd18-4c33-a68a-08f1a12d851a]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:10:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:59 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd Feb 26 03:10:59 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:10:59 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Feb 26 03:10:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd" returned: 0 in 0.462s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:10:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:10:59 devstack sudo[86830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd Feb 26 03:10:59 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:00 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd" returned: 1 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Downloaded image 95c0faf7-23d7-4587-ab20-846f22462e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}])) to volume da289082-34ee-448f-8996-16f5d6adc3dd successfully. {{(pid=83121) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Temporary image 95c0faf7-23d7-4587-ab20-846f22462e10 for user be9686054c784dd293c5dd0062ac78e9 is deleted. {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Marking volume da289082-34ee-448f-8996-16f5d6adc3dd as bootable. {{(pid=83121) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Copying metadata from image 95c0faf7-23d7-4587-ab20-846f22462e10 to da289082-34ee-448f-8996-16f5d6adc3dd. {{(pid=83121) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Creating volume glance metadata for volume da289082-34ee-448f-8996-16f5d6adc3dd backed by image 95c0faf7-23d7-4587-ab20-846f22462e10 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83121) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c19b60-9099-452a-ae39-a995e1137ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da289082-34ee-448f-8996-16f5d6adc3dd', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3cf1a6-e857-4970-aa08-ac247d440511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:00 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Volume volume-da289082-34ee-448f-8996-16f5d6adc3dd (da289082-34ee-448f-8996-16f5d6adc3dd): created successfully Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3cf1a6-e857-4970-aa08-ac247d440511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (0c83ea4a-bc3f-4b6d-a78a-31be0f8e772e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:00 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-601c3fc1-0dc2-46aa-aa9f-ae73d640a5e2 tempest-VolumesGetTest-279259075 None] Created volume successfully. Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (1026e879-7e5e-4826-a253-1c246460f659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dd19b6-74f4-4fd0-a5fe-010528d22da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dd19b6-74f4-4fd0-a5fe-010528d22da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1954849240',display_name='tempest-VolumesGetTest-Volume-1664007895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1d3721-e580-4716-98d7-84b6d36da17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:01Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9c8949-e206-422d-b0ef-85cc8115ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9c8949-e206-422d-b0ef-85cc8115ee10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e6614e-1eb8-48ff-b22d-a9369b89676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e6614e-1eb8-48ff-b22d-a9369b89676e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1d3721-e580-4716-98d7-84b6d36da17e', 'volume_name': 'volume-ae1d3721-e580-4716-98d7-84b6d36da17e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df035e6-d79a-47f8-b612-3bdb7b420650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df035e6-d79a-47f8-b612-3bdb7b420650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365c2931-d980-4d58-bf2a-967e2ca33f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:00 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Volume ae1d3721-e580-4716-98d7-84b6d36da17e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1d3721-e580-4716-98d7-84b6d36da17e', 'volume_size': 1} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1954849240',display_name='tempest-VolumesGetTest-Volume-1664007895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1d3721-e580-4716-98d7-84b6d36da17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19edebb7ea024b1d80e0e46fb078585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:01Z,use_quota=True,user_id='be9686054c784dd293c5dd0062ac78e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Creating volume ae1d3721-e580-4716-98d7-84b6d36da17e {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:11:00 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:11:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:01 devstack sudo[86835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e 1073741824 Feb 26 03:11:01 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:01 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e 1073741824" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:01 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e Feb 26 03:11:01 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:01 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e" returned: 0 in 0.420s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:11:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365c2931-d980-4d58-bf2a-967e2ca33f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1d3721-e580-4716-98d7-84b6d36da17e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f520b2b7-bfb9-412d-9737-05be210507cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:01 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Volume volume-ae1d3721-e580-4716-98d7-84b6d36da17e (ae1d3721-e580-4716-98d7-84b6d36da17e): created successfully Feb 26 03:11:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f520b2b7-bfb9-412d-9737-05be210507cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Flow 'volume_create_manager' (1026e879-7e5e-4826-a253-1c246460f659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:01 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a782522c-d8d9-47e3-8038-7909a68804c6 tempest-VolumesGetTest-279259075 None] Created volume successfully. Feb 26 03:11:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-ae1d3721-e580-4716-98d7-84b6d36da17e-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Lock "cinder-ae1d3721-e580-4716-98d7-84b6d36da17e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-quobyte-ae1d3721-e580-4716-98d7-84b6d36da17e" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-ae1d3721-e580-4716-98d7-84b6d36da17e" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:03 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6750a07-1ddf-413d-9fab-0eb278697fd6]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:03 devstack sudo[86844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e Feb 26 03:11:03 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:03 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e" returned: 0 in 0.480s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:03 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e Feb 26 03:11:03 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:04 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ae1d3721-e580-4716-98d7-84b6d36da17e" returned: 0 in 0.401s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-ae1d3721-e580-4716-98d7-84b6d36da17e" released by "delete_volume" :: held 0.903s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Created reservations ['f6e61961-f6ae-4bd4-bc0c-c0633388cb53', '497cf0cb-6338-47d0-bd3d-6504ed840673', '4413f409-2546-4fa0-9675-53e8290ad92f', '14a9341f-00c9-4dc0-b345-eb66a133f2b9'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:04 devstack sudo[86852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:04 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-da289082-34ee-448f-8996-16f5d6adc3dd-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Lock "cinder-da289082-34ee-448f-8996-16f5d6adc3dd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Acquiring lock "cinder-quobyte-da289082-34ee-448f-8996-16f5d6adc3dd" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-da289082-34ee-448f-8996-16f5d6adc3dd" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5567ea4a-f5c2-428e-964b-05639e11be55]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:04 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd Feb 26 03:11:04 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:04 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.462s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:04 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Deleted volume successfully. Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-218f95cc-e56a-485b-b568-e72fd8be2676 tempest-VolumesGetTest-279259075 None] Lock "cinder-ae1d3721-e580-4716-98d7-84b6d36da17e-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:04 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd" returned: 0 in 0.497s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:04 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd Feb 26 03:11:04 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:05 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd" returned: 1 in 0.485s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:05 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd Feb 26 03:11:05 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:05 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-da289082-34ee-448f-8996-16f5d6adc3dd" returned: 0 in 0.406s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Lock "cinder-quobyte-da289082-34ee-448f-8996-16f5d6adc3dd" released by "delete_volume" :: held 1.431s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Created reservations ['25eef358-ca73-46ad-b28e-2a16b8dffef6', '227f85fd-90f9-4f2b-9104-10dfe1302714', '8cee112c-3d68-4b8e-9878-20b3b9f7bca1', '09343e58-6b97-4149-b690-8b7c3260b44e'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:05 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:05 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:06 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.391s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:06 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:06 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Deleted volume successfully. Feb 26 03:11:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1b3b7568-7206-4eea-bb24-3dc59e42a3a8 tempest-VolumesGetTest-279259075 None] Lock "cinder-da289082-34ee-448f-8996-16f5d6adc3dd-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Flow 'volume_create_manager' (0076a472-225d-4dbd-838c-25c33ea9d92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfa4964-aeea-40e2-9525-f978f2f5e219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfa4964-aeea-40e2-9525-f978f2f5e219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1511751776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8fafbd-d685-4822-951c-50bdb4a1d661,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c119c5ce29b0418f898651a7c33c947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:09Z,use_quota=True,user_id='4ee993e3c67b49ce93f0dd7e625eb97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a3c696-873f-4c6f-a1d2-6603ae6bd97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a3c696-873f-4c6f-a1d2-6603ae6bd97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c7c936-57d3-4ed4-b57e-06256a336ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c7c936-57d3-4ed4-b57e-06256a336ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8fafbd-d685-4822-951c-50bdb4a1d661', 'volume_name': 'volume-df8fafbd-d685-4822-951c-50bdb4a1d661', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0d8c53-3b19-4b99-9a33-893fb8c51868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0d8c53-3b19-4b99-9a33-893fb8c51868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7d5542-ba18-4938-bc52-4c5eff3ad004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:09 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Volume df8fafbd-d685-4822-951c-50bdb4a1d661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8fafbd-d685-4822-951c-50bdb4a1d661', 'volume_size': 1} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1511751776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8fafbd-d685-4822-951c-50bdb4a1d661,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c119c5ce29b0418f898651a7c33c947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:09Z,use_quota=True,user_id='4ee993e3c67b49ce93f0dd7e625eb97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Creating volume df8fafbd-d685-4822-951c-50bdb4a1d661 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:11:09 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:09 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661 1073741824 Feb 26 03:11:09 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:09 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661 1073741824" returned: 0 in 0.449s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:10 devstack sudo[86917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661 Feb 26 03:11:10 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:10 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7d5542-ba18-4938-bc52-4c5eff3ad004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8fafbd-d685-4822-951c-50bdb4a1d661', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f680e4-9677-4a88-ada2-80d591d3dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:10 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Volume volume-df8fafbd-d685-4822-951c-50bdb4a1d661 (df8fafbd-d685-4822-951c-50bdb4a1d661): created successfully Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f680e4-9677-4a88-ada2-80d591d3dde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Flow 'volume_create_manager' (0076a472-225d-4dbd-838c-25c33ea9d92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:10 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-faae5cde-b940-4094-9093-eac25ad8972c tempest-VolumesListTestJSON-573662256 None] Created volume successfully. Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Flow 'volume_create_manager' (9894c705-22a9-45f5-b88f-cdd9011a885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22673ef-04ed-4457-ae82-2d1c3cd7a48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22673ef-04ed-4457-ae82-2d1c3cd7a48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2091723728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafe7030-1d88-4b1b-8334-657f3999cb06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c119c5ce29b0418f898651a7c33c947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:11Z,use_quota=True,user_id='4ee993e3c67b49ce93f0dd7e625eb97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d9f4bd-74e8-4a9b-bd88-13c50d54949c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d9f4bd-74e8-4a9b-bd88-13c50d54949c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a330b3-946d-4dc2-83c3-bc0f6ae6063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a330b3-946d-4dc2-83c3-bc0f6ae6063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafe7030-1d88-4b1b-8334-657f3999cb06', 'volume_name': 'volume-dafe7030-1d88-4b1b-8334-657f3999cb06', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3daf0aeb-fe00-4c11-aa84-fb94a263d6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3daf0aeb-fe00-4c11-aa84-fb94a263d6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c414e7c-0f76-4be0-9ea0-0bf20854e4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:10 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Volume dafe7030-1d88-4b1b-8334-657f3999cb06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafe7030-1d88-4b1b-8334-657f3999cb06', 'volume_size': 1} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2091723728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafe7030-1d88-4b1b-8334-657f3999cb06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c119c5ce29b0418f898651a7c33c947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:11Z,use_quota=True,user_id='4ee993e3c67b49ce93f0dd7e625eb97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Creating volume dafe7030-1d88-4b1b-8334-657f3999cb06 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:11:10 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:11:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:10 devstack sudo[86920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06 1073741824 Feb 26 03:11:10 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:11 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06 1073741824" returned: 0 in 0.449s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:11 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06 Feb 26 03:11:11 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:11 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06" returned: 0 in 0.391s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:11 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:11:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c414e7c-0f76-4be0-9ea0-0bf20854e4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafe7030-1d88-4b1b-8334-657f3999cb06', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3730e63-90ce-4267-8dc5-5ec063ce411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:11 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Volume volume-dafe7030-1d88-4b1b-8334-657f3999cb06 (dafe7030-1d88-4b1b-8334-657f3999cb06): created successfully Feb 26 03:11:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3730e63-90ce-4267-8dc5-5ec063ce411d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Flow 'volume_create_manager' (9894c705-22a9-45f5-b88f-cdd9011a885c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:11 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a251e4e8-473e-4c99-9a67-6a236ccfa87d tempest-VolumesListTestJSON-573662256 None] Created volume successfully. Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Flow 'volume_create_manager' (afa98064-0f60-4a2e-ba31-b3b23de54c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646e1ff8-2122-4793-b670-0530ef0953d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646e1ff8-2122-4793-b670-0530ef0953d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1971768478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae23d76-2578-4260-8f06-788f4e9e0647,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c119c5ce29b0418f898651a7c33c947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:12Z,use_quota=True,user_id='4ee993e3c67b49ce93f0dd7e625eb97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ea4a37-6498-4730-8e33-90a9fec352d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ea4a37-6498-4730-8e33-90a9fec352d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267acf77-f604-404d-8923-546d4510dc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267acf77-f604-404d-8923-546d4510dc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae23d76-2578-4260-8f06-788f4e9e0647', 'volume_name': 'volume-dae23d76-2578-4260-8f06-788f4e9e0647', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a247a6de-2312-4ef6-b095-1763a8ebc504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a247a6de-2312-4ef6-b095-1763a8ebc504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7926cd9c-a230-444e-b770-65e2ed24c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:12 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Volume dae23d76-2578-4260-8f06-788f4e9e0647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae23d76-2578-4260-8f06-788f4e9e0647', 'volume_size': 1} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1971768478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae23d76-2578-4260-8f06-788f4e9e0647,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c119c5ce29b0418f898651a7c33c947f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:12Z,use_quota=True,user_id='4ee993e3c67b49ce93f0dd7e625eb97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Creating volume dae23d76-2578-4260-8f06-788f4e9e0647 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:11:12 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:12 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647 1073741824 Feb 26 03:11:12 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:12 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647 1073741824" returned: 0 in 0.455s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:12 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647 Feb 26 03:11:12 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:13 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647" returned: 0 in 0.424s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:11:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7926cd9c-a230-444e-b770-65e2ed24c89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae23d76-2578-4260-8f06-788f4e9e0647', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3856471a-cc64-4c2f-8d59-8c874f8f681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:13 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Volume volume-dae23d76-2578-4260-8f06-788f4e9e0647 (dae23d76-2578-4260-8f06-788f4e9e0647): created successfully Feb 26 03:11:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3856471a-cc64-4c2f-8d59-8c874f8f681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Flow 'volume_create_manager' (afa98064-0f60-4a2e-ba31-b3b23de54c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:13 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3ecf6685-b64e-4088-87e6-d7adc39f8422 tempest-VolumesListTestJSON-573662256 None] Created volume successfully. Feb 26 03:11:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Acquiring lock "cinder-dae23d76-2578-4260-8f06-788f4e9e0647-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Lock "cinder-dae23d76-2578-4260-8f06-788f4e9e0647-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Acquiring lock "cinder-quobyte-dae23d76-2578-4260-8f06-788f4e9e0647" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Lock "cinder-quobyte-dae23d76-2578-4260-8f06-788f4e9e0647" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:15 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[063bef12-be15-436f-b0d5-7e49925c66fd]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:15 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647 Feb 26 03:11:15 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:15 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647" returned: 0 in 0.480s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:15 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647 Feb 26 03:11:15 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:16 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dae23d76-2578-4260-8f06-788f4e9e0647" returned: 0 in 0.384s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Lock "cinder-quobyte-dae23d76-2578-4260-8f06-788f4e9e0647" released by "delete_volume" :: held 0.895s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Created reservations ['8e33b155-5d79-4201-b039-41d6d7ec5815', '3cf04aaf-79a0-4224-928c-783f2621631a', '913b40b5-0cb2-4e5a-b22a-5ebbd933043e', '886ebc25-b8b8-490d-9663-6cc2b704a28c'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:16 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:16 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Acquiring lock "cinder-dafe7030-1d88-4b1b-8334-657f3999cb06-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Lock "cinder-dafe7030-1d88-4b1b-8334-657f3999cb06-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Acquiring lock "cinder-quobyte-dafe7030-1d88-4b1b-8334-657f3999cb06" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Lock "cinder-quobyte-dafe7030-1d88-4b1b-8334-657f3999cb06" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd33e06c-f58a-4754-9214-d32b35ec5c32]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:16 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06 Feb 26 03:11:16 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:16 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.451s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:16 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Deleted volume successfully. Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0663f165-4a40-45b2-84e0-83cbe7de6e54 tempest-VolumesListTestJSON-573662256 None] Lock "cinder-dae23d76-2578-4260-8f06-788f4e9e0647-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:16 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06" returned: 0 in 0.495s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:16 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06 Feb 26 03:11:16 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:17 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dafe7030-1d88-4b1b-8334-657f3999cb06" returned: 0 in 0.384s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Lock "cinder-quobyte-dafe7030-1d88-4b1b-8334-657f3999cb06" released by "delete_volume" :: held 0.903s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Created reservations ['a32bc045-83a7-4c92-af84-ec4b27e7c97c', '51d9d745-cf26-42e9-a523-b7f7f5b1305a', '1cc21a52-132c-4026-bc55-613ac8c3efda', '740ba4cb-0f1a-4704-9c67-d05c2783b8aa'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:17 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:17 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Acquiring lock "cinder-df8fafbd-d685-4822-951c-50bdb4a1d661-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Lock "cinder-df8fafbd-d685-4822-951c-50bdb4a1d661-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Acquiring lock "cinder-quobyte-df8fafbd-d685-4822-951c-50bdb4a1d661" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Lock "cinder-quobyte-df8fafbd-d685-4822-951c-50bdb4a1d661" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[20848458-9e18-475b-a400-22f1631fdf84]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:17 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661 Feb 26 03:11:17 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:17 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.429s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:17 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Deleted volume successfully. Feb 26 03:11:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-be289edf-63bc-4ecb-a3a9-1f3ed94e9aaa tempest-VolumesListTestJSON-573662256 None] Lock "cinder-dafe7030-1d88-4b1b-8334-657f3999cb06-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:18 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661" returned: 0 in 0.513s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:18 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661 Feb 26 03:11:18 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:18 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-df8fafbd-d685-4822-951c-50bdb4a1d661" returned: 0 in 0.392s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Lock "cinder-quobyte-df8fafbd-d685-4822-951c-50bdb4a1d661" released by "delete_volume" :: held 0.928s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Created reservations ['5dfc9853-94f2-47b5-962c-9e85f0db81c4', '9e50bde2-c900-4bd2-a95a-e082da83d6a6', '083970ba-38bc-45ce-8355-9a49978bd86c', 'cd2cacab-c5d8-4759-b009-c97b6cfc7d26'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:18 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:18 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:19 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.505s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:19 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:19 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Deleted volume successfully. Feb 26 03:11:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e1fb0dba-8133-46a7-a5cb-4c2e27d8f37b tempest-VolumesListTestJSON-573662256 None] Lock "cinder-df8fafbd-d685-4822-951c-50bdb4a1d661-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Flow 'volume_create_manager' (874a0ea4-e92a-4ee1-9d78-01192fc60d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b312f6b-03d4-4ce4-9bcf-daf141f29498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b312f6b-03d4-4ce4-9bcf-daf141f29498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1593987415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30024771-2fc2-415a-b58e-bc04494601c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961a5e26f6ec415db88ca5113c7065d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:20Z,use_quota=True,user_id='acbacd861286406f9d01cc14388cab9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae8503e-719b-48fe-9aa5-9c9aa619b686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae8503e-719b-48fe-9aa5-9c9aa619b686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3914687-0c9c-4431-a492-36568bc35501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3914687-0c9c-4431-a492-36568bc35501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30024771-2fc2-415a-b58e-bc04494601c4', 'volume_name': 'volume-30024771-2fc2-415a-b58e-bc04494601c4', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f669ff2f-b120-40fc-bdc5-e734f6d5de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f669ff2f-b120-40fc-bdc5-e734f6d5de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278c819a-4d43-420e-892c-730d25410d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:20 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Volume 30024771-2fc2-415a-b58e-bc04494601c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30024771-2fc2-415a-b58e-bc04494601c4', 'volume_size': 1} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1593987415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30024771-2fc2-415a-b58e-bc04494601c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961a5e26f6ec415db88ca5113c7065d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:20Z,use_quota=True,user_id='acbacd861286406f9d01cc14388cab9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Creating volume 30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:11:20 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:20 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 1073741824 Feb 26 03:11:20 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:20 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 1073741824" returned: 0 in 0.457s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:20 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 Feb 26 03:11:20 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:21 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4" returned: 0 in 0.387s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278c819a-4d43-420e-892c-730d25410d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30024771-2fc2-415a-b58e-bc04494601c4', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0909ccec-d3bd-4299-878c-8410319acd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:21 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Volume volume-30024771-2fc2-415a-b58e-bc04494601c4 (30024771-2fc2-415a-b58e-bc04494601c4): created successfully Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0909ccec-d3bd-4299-878c-8410319acd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Flow 'volume_create_manager' (874a0ea4-e92a-4ee1-9d78-01192fc60d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:21 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-60a4bf43-d325-4e4b-ba15-c9f1afafc2f5 tempest-VolumesSnapshotListTestJSON-64778102 None] Created volume successfully. Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Creating offline snapshot 86f91d24-c80c-4c24-a592-af8616de5549 of volume 30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a533da9-42e5-472c-ad3b-62c1700abd2d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:21 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 Feb 26 03:11:21 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:21 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4" returned: 0 in 0.454s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:21 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 1G Feb 26 03:11:21 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:22 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 1G" returned: 0 in 0.451s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30024771-2fc2-415a-b58e-bc04494601c4 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:22 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30024771-2fc2-415a-b58e-bc04494601c4 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 Feb 26 03:11:22 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:22 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30024771-2fc2-415a-b58e-bc04494601c4 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549" returned: 0 in 0.431s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:22 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 is being set with open permissions: ugo+rw Feb 26 03:11:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:22 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 Feb 26 03:11:22 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:23 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:23 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.info Feb 26 03:11:23 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:23 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.info" returned: 0 in 0.408s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:23 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.info is being set with open permissions: ugo+rw Feb 26 03:11:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:23 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.info Feb 26 03:11:23 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:24 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.info" returned: 0 in 0.417s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b5ee04e6-77c9-4b02-b8ed-53ccaf82813d tempest-VolumesSnapshotListTestJSON-64778102 None] Create snapshot completed successfully Feb 26 03:11:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] Creating offline snapshot 78ef701b-b86d-43fb-998e-2786ef40f15d of volume 30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:11:24 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c347959-48f4-4d1e-bfc4-991c4e6ab904]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:24 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 Feb 26 03:11:24 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:25 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549" returned: 0 in 0.500s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30024771-2fc2-415a-b58e-bc04494601c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:11:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:25 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d 1G Feb 26 03:11:25 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:25 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d 1G" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:25 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d Feb 26 03:11:25 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:26 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d" returned: 0 in 0.473s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:26 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d is being set with open permissions: ugo+rw Feb 26 03:11:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:26 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d Feb 26 03:11:26 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:26 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6dca9734-830f-4f89-8613-87387879a588 tempest-VolumesSnapshotListTestJSON-64778102 None] Create snapshot completed successfully Feb 26 03:11:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] Creating offline snapshot 05056a8d-536d-4cbb-8327-d58740cc42be of volume 30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:11:26 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[87207975-ea50-47e0-bf56-47b94113a3a4]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:26 devstack sudo[87023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d Feb 26 03:11:26 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:27 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d" returned: 0 in 0.476s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30024771-2fc2-415a-b58e-bc04494601c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:11:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:27 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be 1G Feb 26 03:11:27 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:27 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be 1G" returned: 0 in 0.477s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:27 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be Feb 26 03:11:27 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:28 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be" returned: 0 in 0.435s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:28 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be is being set with open permissions: ugo+rw Feb 26 03:11:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:28 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be Feb 26 03:11:28 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:28 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be" returned: 0 in 0.388s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:28 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-73a3562d-c8ec-4f54-bd2b-2fed30ada44c tempest-VolumesSnapshotListTestJSON-64778102 None] Create snapshot completed successfully Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-05056a8d-536d-4cbb-8327-d58740cc42be-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-05056a8d-536d-4cbb-8327-d58740cc42be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-quobyte-05056a8d-536d-4cbb-8327-d58740cc42be" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-05056a8d-536d-4cbb-8327-d58740cc42be" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Deleting offline snapshot 05056a8d-536d-4cbb-8327-d58740cc42be of volume 30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] snapshot_file for this snap is: volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2d1b06-43a6-4113-bd2b-9479a8e3192b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:29 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be Feb 26 03:11:29 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:29 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be" returned: 0 in 0.486s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30024771-2fc2-415a-b58e-bc04494601c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:11:30 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fde0495-397c-4055-92a9-90d521b93aff]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:30 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d Feb 26 03:11:30 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:30 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d" returned: 0 in 0.455s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30024771-2fc2-415a-b58e-bc04494601c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:11:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:30 devstack sudo[87051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be Feb 26 03:11:30 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:30 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be" returned: 0 in 0.480s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:30 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be Feb 26 03:11:30 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:31 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.05056a8d-536d-4cbb-8327-d58740cc42be" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-05056a8d-536d-4cbb-8327-d58740cc42be" released by "_delete_snapshot" :: held 1.859s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" released by "delete_snapshot" :: held 1.871s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Created reservations ['6c571c26-90fc-4f52-890e-6ef9e2b642d3', '9fb59b12-7f9b-4d1b-8cc8-f64755294ac2', '6fc3a0a5-dd66-45e0-bf42-62da5643228d', 'd1409758-f785-4ad4-b8e6-fb59b9debba1'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:31 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Delete snapshot completed successfully. Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b269d33-b249-4cc4-9921-4968825b7272 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-05056a8d-536d-4cbb-8327-d58740cc42be-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-78ef701b-b86d-43fb-998e-2786ef40f15d-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-78ef701b-b86d-43fb-998e-2786ef40f15d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-quobyte-78ef701b-b86d-43fb-998e-2786ef40f15d" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-78ef701b-b86d-43fb-998e-2786ef40f15d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Deleting offline snapshot 78ef701b-b86d-43fb-998e-2786ef40f15d of volume 30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] snapshot_file for this snap is: volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[180c55e5-07b5-4adb-946a-54f2b38b82fc]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:31 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d Feb 26 03:11:31 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:32 devstack sudo[87065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:32 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:32 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d" returned: 0 in 0.482s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30024771-2fc2-415a-b58e-bc04494601c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adc6c6f-3bd6-4742-92ed-aaa102de294e]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:32 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 Feb 26 03:11:32 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:32 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.391s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:32 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549" returned: 0 in 0.460s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30024771-2fc2-415a-b58e-bc04494601c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:11:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:32 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d Feb 26 03:11:32 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:33 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d" returned: 0 in 0.465s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:33 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d Feb 26 03:11:33 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:33 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.78ef701b-b86d-43fb-998e-2786ef40f15d" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-78ef701b-b86d-43fb-998e-2786ef40f15d" released by "_delete_snapshot" :: held 1.840s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" released by "delete_snapshot" :: held 1.852s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Created reservations ['b6460d3c-20a4-4aa7-b273-59f065e63a4f', '9a8d076e-f375-444f-9a2c-0d51e609ef60', '2fa06ddb-c47b-4383-9505-29bd8f90bd28', '9762457c-ed39-4522-98e8-0a8cf608a2fe'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Delete snapshot completed successfully. Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6801322d-de6d-4aa4-9672-4565c2ca744f tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-78ef701b-b86d-43fb-998e-2786ef40f15d-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-86f91d24-c80c-4c24-a592-af8616de5549-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-86f91d24-c80c-4c24-a592-af8616de5549-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-quobyte-86f91d24-c80c-4c24-a592-af8616de5549" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-86f91d24-c80c-4c24-a592-af8616de5549" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Deleting offline snapshot 86f91d24-c80c-4c24-a592-af8616de5549 of volume 30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] snapshot_file for this snap is: volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[58033d4b-83a4-4b21-913e-60719fab46e3]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:33 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 Feb 26 03:11:33 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:34 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549" returned: 0 in 0.506s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30024771-2fc2-415a-b58e-bc04494601c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:11:34 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc0468-52d4-45c3-8601-1aa77b030921]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:34 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 Feb 26 03:11:34 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:34 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4" returned: 0 in 0.468s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:34 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 Feb 26 03:11:34 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:35 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549" returned: 0 in 0.437s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:35 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549 Feb 26 03:11:35 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:35 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4.86f91d24-c80c-4c24-a592-af8616de5549" returned: 0 in 0.425s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-86f91d24-c80c-4c24-a592-af8616de5549" released by "_delete_snapshot" :: held 1.889s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" released by "delete_snapshot" :: held 1.898s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Created reservations ['49392139-fda2-4db2-85bc-1c04cf8dcfce', '1079d951-b14d-47b4-b2d8-0e7397a22680', '5a7d871e-2732-474e-a65d-b0c1a26bf618', 'a6cf1b63-528f-4fbd-a256-48836303d327'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:35 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Delete snapshot completed successfully. Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-325dde45-75c6-4414-b002-bd238ae15e68 tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-86f91d24-c80c-4c24-a592-af8616de5549-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-30024771-2fc2-415a-b58e-bc04494601c4-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-30024771-2fc2-415a-b58e-bc04494601c4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9830315e-10d9-4fa4-ab1d-9856806ccb7a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:35 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 Feb 26 03:11:35 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:36 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:36 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4 Feb 26 03:11:36 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:36 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-30024771-2fc2-415a-b58e-bc04494601c4" returned: 0 in 0.403s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-quobyte-30024771-2fc2-415a-b58e-bc04494601c4" released by "delete_volume" :: held 0.917s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Created reservations ['97bcfddf-08a6-4864-a2c6-27775a76bb58', '42035204-0a5e-46d9-b252-4f4587a6f4c7', '8fd4d63b-e6c6-458a-876d-33a486e584fc', '588329bc-9bbd-45b1-9302-04e5a9e7e1ed'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:36 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:36 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:37 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.435s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:37 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:37 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Deleted volume successfully. Feb 26 03:11:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7e326328-ba0c-444b-9c17-7059ad1d2c3b tempest-VolumesSnapshotListTestJSON-64778102 None] Lock "cinder-30024771-2fc2-415a-b58e-bc04494601c4-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Flow 'volume_create_manager' (ef448509-5c2d-41b4-a28e-c9cea9c2baf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d306738b-9360-4ba6-8ab7-cd594f4414af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d306738b-9360-4ba6-8ab7-cd594f4414af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-817994660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fcc439-9058-4978-a1ee-1b1a687a3da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68fd930ceb4a66ac16372526d3de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:39Z,use_quota=True,user_id='c7079daac2dd4aa79b56e1119f561c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d182a53b-ffc7-4d58-9889-6cebba8555a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d182a53b-ffc7-4d58-9889-6cebba8555a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a6db01-231a-4cb5-ba0e-32f4267aa02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a6db01-231a-4cb5-ba0e-32f4267aa02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92fcc439-9058-4978-a1ee-1b1a687a3da3', 'volume_name': 'volume-92fcc439-9058-4978-a1ee-1b1a687a3da3', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125f8ba8-44d2-408b-9171-f7a78ca5860b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125f8ba8-44d2-408b-9171-f7a78ca5860b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56865dd6-a93b-4b7a-b2b4-f2d03c4af34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:38 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Volume 92fcc439-9058-4978-a1ee-1b1a687a3da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92fcc439-9058-4978-a1ee-1b1a687a3da3', 'volume_size': 1} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-817994660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fcc439-9058-4978-a1ee-1b1a687a3da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68fd930ceb4a66ac16372526d3de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:39Z,use_quota=True,user_id='c7079daac2dd4aa79b56e1119f561c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Creating volume 92fcc439-9058-4978-a1ee-1b1a687a3da3 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:11:38 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:38 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3 1073741824 Feb 26 03:11:38 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Flow 'volume_create_manager' (50943704-04fc-4a7f-94ab-5cd9072a181d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008ef26b-e240-4dcf-afce-5b0e720b5b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008ef26b-e240-4dcf-afce-5b0e720b5b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1222754189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb8cc609-3840-4d63-ad83-5a197db1e27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68fd930ceb4a66ac16372526d3de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:39Z,use_quota=True,user_id='c7079daac2dd4aa79b56e1119f561c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29eba273-99cc-44fd-a754-db6e478b003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29eba273-99cc-44fd-a754-db6e478b003a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a491b8-0c17-4eaa-8165-dd8b0758ee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a491b8-0c17-4eaa-8165-dd8b0758ee3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb8cc609-3840-4d63-ad83-5a197db1e27c', 'volume_name': 'volume-bb8cc609-3840-4d63-ad83-5a197db1e27c', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcdb02a6-5afd-416e-a418-9b8e0d0c26b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcdb02a6-5afd-416e-a418-9b8e0d0c26b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4994cdb7-9a33-4013-a724-fde674d9e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:38 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Volume bb8cc609-3840-4d63-ad83-5a197db1e27c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb8cc609-3840-4d63-ad83-5a197db1e27c', 'volume_size': 1} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:38 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Flow 'volume_create_manager' (59155911-a1a8-4c7c-bdf4-538ee371fa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ac3e33-6fef-48f1-bdb5-14d7e0e449d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ac3e33-6fef-48f1-bdb5-14d7e0e449d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1327142499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe69c5b-d80f-41bb-a9f0-91f17361e417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68fd930ceb4a66ac16372526d3de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:39Z,use_quota=True,user_id='c7079daac2dd4aa79b56e1119f561c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd1b18d-ce87-4a86-a20d-f89726e003e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd1b18d-ce87-4a86-a20d-f89726e003e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd927e7-3e65-4e49-a9a2-d57e81cd8c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd927e7-3e65-4e49-a9a2-d57e81cd8c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fe69c5b-d80f-41bb-a9f0-91f17361e417', 'volume_name': 'volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94a6221-f0f6-4d06-bf7b-d2e712b736fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94a6221-f0f6-4d06-bf7b-d2e712b736fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256bc828-a803-4af4-9786-af5a5f63ed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Volume 3fe69c5b-d80f-41bb-a9f0-91f17361e417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417', 'volume_size': 1} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Flow 'volume_create_manager' (cc4007ad-efe4-48ad-a213-8794cdd64336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6a0468-2936-4ceb-b423-b650d7ea3566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6a0468-2936-4ceb-b423-b650d7ea3566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1045208546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554cff5e-ff93-40dc-8298-9e3fbe28aafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68fd930ceb4a66ac16372526d3de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:39Z,use_quota=True,user_id='c7079daac2dd4aa79b56e1119f561c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32284cd-c4a6-45fd-8ac0-2d8027f9f131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32284cd-c4a6-45fd-8ac0-2d8027f9f131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88df0fe0-53a0-4b2e-afc8-860cce818008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88df0fe0-53a0-4b2e-afc8-860cce818008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554cff5e-ff93-40dc-8298-9e3fbe28aafe', 'volume_name': 'volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454f8e72-03a8-41e1-a98b-4841bf283e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454f8e72-03a8-41e1-a98b-4841bf283e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc083fa-6cdb-421b-aa7f-c4c1c42923e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Volume 554cff5e-ff93-40dc-8298-9e3fbe28aafe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe', 'volume_size': 1} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:39 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3 1073741824" returned: 0 in 0.603s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:39 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3 Feb 26 03:11:39 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Flow 'volume_create_manager' (9444c101-2038-45db-80f3-39341d5abe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edfedc6-21ac-47ba-829b-96f3e35e41e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edfedc6-21ac-47ba-829b-96f3e35e41e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359616904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5123e571-4676-42ab-943c-974c77ed2b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68fd930ceb4a66ac16372526d3de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:39Z,use_quota=True,user_id='c7079daac2dd4aa79b56e1119f561c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d819c5d0-f04d-457f-b0bf-5d47ffcf641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d819c5d0-f04d-457f-b0bf-5d47ffcf641b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07731ab1-b869-46d6-9804-8bdd8832b8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07731ab1-b869-46d6-9804-8bdd8832b8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5123e571-4676-42ab-943c-974c77ed2b76', 'volume_name': 'volume-5123e571-4676-42ab-943c-974c77ed2b76', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ec385d-3b9e-48de-9a4e-b5ac47df718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ec385d-3b9e-48de-9a4e-b5ac47df718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc8f6f0-674e-4cf9-9ea5-fee9303bb0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Volume 5123e571-4676-42ab-943c-974c77ed2b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5123e571-4676-42ab-943c-974c77ed2b76', 'volume_size': 1} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:39 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1222754189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb8cc609-3840-4d63-ad83-5a197db1e27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68fd930ceb4a66ac16372526d3de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:39Z,use_quota=True,user_id='c7079daac2dd4aa79b56e1119f561c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Creating volume bb8cc609-3840-4d63-ad83-5a197db1e27c {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:11:39 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56865dd6-a93b-4b7a-b2b4-f2d03c4af34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92fcc439-9058-4978-a1ee-1b1a687a3da3', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c 1073741824 Feb 26 03:11:39 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3435ee-704e-4c32-8fdf-00d696446063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:39 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Volume volume-92fcc439-9058-4978-a1ee-1b1a687a3da3 (92fcc439-9058-4978-a1ee-1b1a687a3da3): created successfully Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3435ee-704e-4c32-8fdf-00d696446063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Flow 'volume_create_manager' (ef448509-5c2d-41b4-a28e-c9cea9c2baf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:39 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-598f9ae8-d292-42bd-a6bc-bc66637cb822 tempest-CreateVolumesFromImageTest-72202947 None] Created volume successfully. Feb 26 03:11:40 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c 1073741824" returned: 0 in 0.487s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:40 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c Feb 26 03:11:40 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:40 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c" returned: 0 in 0.392s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1327142499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe69c5b-d80f-41bb-a9f0-91f17361e417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68fd930ceb4a66ac16372526d3de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:39Z,use_quota=True,user_id='c7079daac2dd4aa79b56e1119f561c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Creating volume 3fe69c5b-d80f-41bb-a9f0-91f17361e417 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:11:40 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4994cdb7-9a33-4013-a724-fde674d9e34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb8cc609-3840-4d63-ad83-5a197db1e27c', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:40 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417 1073741824 Feb 26 03:11:40 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8e67d9-e8ca-44bb-ab32-b861b735cc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:40 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Volume volume-bb8cc609-3840-4d63-ad83-5a197db1e27c (bb8cc609-3840-4d63-ad83-5a197db1e27c): created successfully Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8e67d9-e8ca-44bb-ab32-b861b735cc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Flow 'volume_create_manager' (50943704-04fc-4a7f-94ab-5cd9072a181d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:40 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-376ddf86-93a1-4a96-9d84-cd97b864ea56 tempest-CreateVolumesFromImageTest-72202947 None] Created volume successfully. Feb 26 03:11:41 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417 1073741824" returned: 0 in 0.486s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:41 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417 Feb 26 03:11:41 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:41 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417" returned: 0 in 0.411s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1045208546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554cff5e-ff93-40dc-8298-9e3fbe28aafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68fd930ceb4a66ac16372526d3de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:39Z,use_quota=True,user_id='c7079daac2dd4aa79b56e1119f561c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Creating volume 554cff5e-ff93-40dc-8298-9e3fbe28aafe {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:11:41 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:41 devstack sudo[87135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe 1073741824 Feb 26 03:11:41 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256bc828-a803-4af4-9786-af5a5f63ed5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14f1dea-26be-49cd-968d-8fe9f5293d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:41 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Volume volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417 (3fe69c5b-d80f-41bb-a9f0-91f17361e417): created successfully Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14f1dea-26be-49cd-968d-8fe9f5293d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Flow 'volume_create_manager' (59155911-a1a8-4c7c-bdf4-538ee371fa35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:41 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5055c22a-fba7-407c-9a04-15224ac4506a tempest-CreateVolumesFromImageTest-72202947 None] Created volume successfully. Feb 26 03:11:42 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe 1073741824" returned: 0 in 0.454s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:42 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe Feb 26 03:11:42 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:42 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe" returned: 0 in 0.399s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.988s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359616904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5123e571-4676-42ab-943c-974c77ed2b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68fd930ceb4a66ac16372526d3de76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:11:39Z,use_quota=True,user_id='c7079daac2dd4aa79b56e1119f561c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Creating volume 5123e571-4676-42ab-943c-974c77ed2b76 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:11:42 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc083fa-6cdb-421b-aa7f-c4c1c42923e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87343512-bc14-41e7-929c-c0cba1383924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:42 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76 1073741824 Feb 26 03:11:42 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:42 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Volume volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe (554cff5e-ff93-40dc-8298-9e3fbe28aafe): created successfully Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87343512-bc14-41e7-929c-c0cba1383924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Flow 'volume_create_manager' (cc4007ad-efe4-48ad-a213-8794cdd64336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:42 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b2c4241c-5229-443a-aad9-7ce8dd2ebf57 tempest-CreateVolumesFromImageTest-72202947 None] Created volume successfully. Feb 26 03:11:42 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76 1073741824" returned: 0 in 0.459s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:42 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76 Feb 26 03:11:42 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:43 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76" returned: 0 in 0.389s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc8f6f0-674e-4cf9-9ea5-fee9303bb0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5123e571-4676-42ab-943c-974c77ed2b76', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a92285-8486-4635-b214-f63927e38401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:11:43 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Volume volume-5123e571-4676-42ab-943c-974c77ed2b76 (5123e571-4676-42ab-943c-974c77ed2b76): created successfully Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a92285-8486-4635-b214-f63927e38401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Flow 'volume_create_manager' (9444c101-2038-45db-80f3-39341d5abe97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:11:43 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f75f9ccb-7b39-47cc-947a-17a785cdefc4 tempest-CreateVolumesFromImageTest-72202947 None] Created volume successfully. Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "cinder-5123e571-4676-42ab-943c-974c77ed2b76-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-5123e571-4676-42ab-943c-974c77ed2b76-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "cinder-quobyte-5123e571-4676-42ab-943c-974c77ed2b76" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-quobyte-5123e571-4676-42ab-943c-974c77ed2b76" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ad2bf4-9a44-4615-a14f-9a728a8b0ae1]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:43 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76 Feb 26 03:11:43 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:44 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76" returned: 0 in 0.472s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:44 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76 Feb 26 03:11:44 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:44 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-5123e571-4676-42ab-943c-974c77ed2b76" returned: 0 in 0.400s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-quobyte-5123e571-4676-42ab-943c-974c77ed2b76" released by "delete_volume" :: held 0.892s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Created reservations ['0a0b7813-fd56-482a-b924-5c9f9e85740f', '91bc0aa6-fc5d-47f8-801f-5f055589322d', '1181852a-1b80-4a27-a576-c0a4bb82d90c', '8a011f70-063f-4f5a-b3ed-509b72bb873c'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:44 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:44 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "cinder-554cff5e-ff93-40dc-8298-9e3fbe28aafe-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-554cff5e-ff93-40dc-8298-9e3fbe28aafe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "cinder-quobyte-554cff5e-ff93-40dc-8298-9e3fbe28aafe" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-quobyte-554cff5e-ff93-40dc-8298-9e3fbe28aafe" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bb0387-0d25-42b5-8dc9-be2d4b4f7021]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:45 devstack sudo[87161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe Feb 26 03:11:45 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:45 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.423s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:45 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Deleted volume successfully. Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ccce65cc-c3aa-49ce-87e2-e0956e505235 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-5123e571-4676-42ab-943c-974c77ed2b76-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:45 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe" returned: 0 in 0.471s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:45 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe Feb 26 03:11:45 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:45 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-554cff5e-ff93-40dc-8298-9e3fbe28aafe" returned: 0 in 0.414s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-quobyte-554cff5e-ff93-40dc-8298-9e3fbe28aafe" released by "delete_volume" :: held 0.907s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Created reservations ['a6470dfc-0ce4-4a59-bb30-a862f29f6dba', '9b1734df-027a-472d-bd27-4004c04c7ee1', '2e5076e7-f9f6-4efc-b7cb-6f6c00ae17fc', 'fb611fe6-66b8-427f-8851-89d7ab2a9fdd'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:45 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:45 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "cinder-3fe69c5b-d80f-41bb-a9f0-91f17361e417-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-3fe69c5b-d80f-41bb-a9f0-91f17361e417-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "cinder-quobyte-3fe69c5b-d80f-41bb-a9f0-91f17361e417" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-quobyte-3fe69c5b-d80f-41bb-a9f0-91f17361e417" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[54591ea5-0dab-4e63-b366-5f97140aaeea]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:46 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417 Feb 26 03:11:46 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:46 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:46 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Deleted volume successfully. Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b041adc0-853a-4229-bd68-d050d4b67ac4 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-554cff5e-ff93-40dc-8298-9e3fbe28aafe-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:46 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417" returned: 0 in 0.458s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:46 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417 Feb 26 03:11:46 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:46 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3fe69c5b-d80f-41bb-a9f0-91f17361e417" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-quobyte-3fe69c5b-d80f-41bb-a9f0-91f17361e417" released by "delete_volume" :: held 0.869s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:46 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Created reservations ['5b79b33f-470c-4130-8d63-1a2fb3001739', '349cbd24-a9bb-46fe-a81e-a1c03ff1b5a4', '6d5d26ab-bb3c-432b-af39-818973bcd3b0', 'abce1500-b774-422f-8705-8ec7961417c8'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:47 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:47 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "cinder-bb8cc609-3840-4d63-ad83-5a197db1e27c-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-bb8cc609-3840-4d63-ad83-5a197db1e27c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "cinder-quobyte-bb8cc609-3840-4d63-ad83-5a197db1e27c" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-quobyte-bb8cc609-3840-4d63-ad83-5a197db1e27c" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b5a25d-1c29-488c-b6d1-5177d95921e8]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:47 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c Feb 26 03:11:47 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:47 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.443s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:47 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Deleted volume successfully. Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e94cfec8-5c3f-48dd-85c5-a6c9f3f98c0c tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-3fe69c5b-d80f-41bb-a9f0-91f17361e417-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:47 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c" returned: 0 in 0.487s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:47 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c Feb 26 03:11:47 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:48 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-bb8cc609-3840-4d63-ad83-5a197db1e27c" returned: 0 in 0.399s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-quobyte-bb8cc609-3840-4d63-ad83-5a197db1e27c" released by "delete_volume" :: held 0.907s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Created reservations ['f6e5bbe1-b4b1-4c42-a2d2-ebb3b45c283d', '68e7d9c6-84be-49c8-a20b-0ae5404b7e1a', '2f26cd7b-3694-4d59-bf2f-eb60ff3e402c', '634ca61a-42dc-4edb-952d-d2234340702c'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:48 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:48 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "cinder-92fcc439-9058-4978-a1ee-1b1a687a3da3-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-92fcc439-9058-4978-a1ee-1b1a687a3da3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "cinder-quobyte-92fcc439-9058-4978-a1ee-1b1a687a3da3" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-quobyte-92fcc439-9058-4978-a1ee-1b1a687a3da3" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaa5ba2-b803-4134-95d7-cf9c09ed4cd1]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:48 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3 Feb 26 03:11:48 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:48 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.421s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:48 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Deleted volume successfully. Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cb56a363-4a16-47df-b4a4-ee8f5aa4a4e3 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-bb8cc609-3840-4d63-ad83-5a197db1e27c-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:48 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3" returned: 0 in 0.459s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:48 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3 Feb 26 03:11:48 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:49 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-92fcc439-9058-4978-a1ee-1b1a687a3da3" returned: 0 in 0.396s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-quobyte-92fcc439-9058-4978-a1ee-1b1a687a3da3" released by "delete_volume" :: held 0.884s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=114,cinder:INSERT=50,cinder:UPDATE=160,cinder:DELETE=12 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=160,cinder:DELETE=16,cinder:SELECT=126,cinder:INSERT=39 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Created reservations ['cfff02e3-8ec1-4633-9f3b-93b1dd1f4caf', '95ad6ba8-1df3-47d3-b418-ae14fcbc24d4', 'de6df458-ca7d-43e7-88dc-c4dccf229476', 'c64d49f9-f256-472e-8833-712358e9ded8'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:11:49 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:11:49 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:11:49 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.462s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:11:49 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Deleted volume successfully. Feb 26 03:11:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3104418d-7716-468d-978d-12af3d75cfd5 tempest-CreateVolumesFromImageTest-72202947 None] Lock "cinder-92fcc439-9058-4978-a1ee-1b1a687a3da3-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:11:59 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=11,cinder:SELECT=3 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:11:59 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=3,cinder:INSERT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:12:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:12:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:12:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:12:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:12:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:12:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:12:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:12:32 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:12:32 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:12:32 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Feb 26 03:12:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.375s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:12:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:13:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:13:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:13:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:13:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:13:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:13:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:13:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:13:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:13:32 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:13:32 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:13:32 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Feb 26 03:13:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.402s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:13:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:14:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:03 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[171841c3-4501-4b62-8215-6cd60080d19a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:03 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 Feb 26 03:14:03 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:04 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:04 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db7611e-66a6-4584-8fd9-ab19fdb82a25]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:04 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 Feb 26 03:14:04 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:04 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544" returned: 0 in 0.473s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.4afdf6c4-4c55-4b04-9ffb-578a9e127e1dral902y7.img {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:04 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.4afdf6c4-4c55-4b04-9ffb-578a9e127e1dral902y7.img Feb 26 03:14:04 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:06 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.4afdf6c4-4c55-4b04-9ffb-578a9e127e1dral902y7.img" returned: 0 in 1.842s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:06 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5426c697-4a2c-423e-a9f0-e95e32a2d3f3]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:06 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 Feb 26 03:14:06 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:06 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544" returned: 0 in 0.578s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:06 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544, size 1024.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.4afdf6c4-4c55-4b04-9ffb-578a9e127e1dral902y7.img {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:14:06 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Converted 1024.00 MB image at 555.71 MB/s Feb 26 03:14:06 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] 4afdf6c4-4c55-4b04-9ffb-578a9e127e1d was raw, no need to convert to raw {{(pid=83121) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 26 03:14:13 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:14:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.317s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Uploaded volume to glance image-id: 4afdf6c4-4c55-4b04-9ffb-578a9e127e1d. {{(pid=83121) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 26 03:14:16 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-af91cb3f-fc64-4e51-ab15-da5dbbff592b tempest-VolumesActionsTest-1460120081 None] Copy volume to image completed successfully. Feb 26 03:14:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:18 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceea0dda-dc18-429d-b921-71d75ad09c91]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:18 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 Feb 26 03:14:18 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:19 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544" returned: 0 in 0.473s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:19 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7826d823-0f86-4fc7-a2b9-17d08a66ba55]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:19 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 Feb 26 03:14:19 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:19 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544" returned: 0 in 0.482s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:19 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img Feb 26 03:14:19 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:21 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img" returned: 0 in 1.920s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:21 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c48d59-fd7c-4310-850b-8a8fc7c04b72]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:21 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 Feb 26 03:14:21 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:22 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544" returned: 0 in 0.582s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:22 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:14:22 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Converted 1024.00 MB image at 533.00 MB/s Feb 26 03:14:22 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4 was raw, converting to qcow2 {{(pid=83121) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 26 03:14:22 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[da375dfd-077d-4b2f-bd38-e26df3fee8a6]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:22 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img Feb 26 03:14:22 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:22 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:22 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img Feb 26 03:14:22 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:23 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img" returned: 1 in 0.465s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:14:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img /opt/stack/data/cinder/conversion/vol_upload_0wzsjxjl {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:23 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img /opt/stack/data/cinder/conversion/vol_upload_0wzsjxjl Feb 26 03:14:23 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:23 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img /opt/stack/data/cinder/conversion/vol_upload_0wzsjxjl" returned: 0 in 0.387s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:23 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Image conversion details: src /opt/stack/data/cinder/conversion/48c0cc2c-13a6-4588-9f4d-02b2adde9544.temp_image.fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4cqx9iys2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_0wzsjxjl {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:14:23 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 26 03:14:23 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[57738ed0-1dc4-4bba-b263-aafe62230199]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0wzsjxjl {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:23 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0wzsjxjl Feb 26 03:14:23 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:23 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0wzsjxjl" returned: 0 in 0.478s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.085s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Uploaded volume to glance image-id: fd0ba7f3-edfd-4f3b-8069-8c1a08f80ce4. {{(pid=83121) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 26 03:14:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-18967edd-7246-43e1-9058-016bede89158 tempest-VolumesActionsTest-1460120081 None] Copy volume to image completed successfully. Feb 26 03:14:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Acquiring lock "cinder-48c0cc2c-13a6-4588-9f4d-02b2adde9544-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Lock "cinder-48c0cc2c-13a6-4588-9f4d-02b2adde9544-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Acquiring lock "cinder-quobyte-48c0cc2c-13a6-4588-9f4d-02b2adde9544" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Lock "cinder-quobyte-48c0cc2c-13a6-4588-9f4d-02b2adde9544" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:25 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5faca6-0aab-41ef-8ad9-16c90e05289f]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:25 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 Feb 26 03:14:25 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:25 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544" returned: 0 in 0.458s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:25 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544 Feb 26 03:14:25 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:26 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-48c0cc2c-13a6-4588-9f4d-02b2adde9544" returned: 0 in 0.392s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Lock "cinder-quobyte-48c0cc2c-13a6-4588-9f4d-02b2adde9544" released by "delete_volume" :: held 0.878s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Created reservations ['67c293de-6968-4447-83c3-432c611897bc', '7a27a79c-8b79-430a-852c-9effcab2d3ac', 'ec3e8135-4aef-4965-b296-bdac0a913cbc', '94ed0fed-b357-4dc2-800b-c356d30e502f'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:26 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:14:26 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:26 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.437s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:14:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Deleted volume successfully. Feb 26 03:14:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-224bb4de-4249-4f56-a80c-4f7ff54b10c3 tempest-VolumesActionsTest-1460120081 None] Lock "cinder-48c0cc2c-13a6-4588-9f4d-02b2adde9544-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Flow 'volume_create_manager' (9a8a5db9-73a9-4a1f-b195-63c696c9614b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd21c4c4-220e-4fb9-b67a-ae6f66baf2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd21c4c4-220e-4fb9-b67a-ae6f66baf2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1555094970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604783f2-cf7c-4c65-9bcf-dad65f4d1f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baee198c78a746a4b9f5592e7308c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:14:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:14:30Z,use_quota=True,user_id='b71c16b1b811488bac40a4b9f195a938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378e864a-c614-4c59-9ab3-8ae8788526b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378e864a-c614-4c59-9ab3-8ae8788526b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d7a78f-dbf5-4810-8542-f7f669cf5267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d7a78f-dbf5-4810-8542-f7f669cf5267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604783f2-cf7c-4c65-9bcf-dad65f4d1f44', 'volume_name': 'volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44', 'volume_size': 2}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af63c929-e61b-4036-a1ad-bf5545c67810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af63c929-e61b-4036-a1ad-bf5545c67810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9ec1dd-896d-45c3-a97e-8a80582563a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:30 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Volume 604783f2-cf7c-4c65-9bcf-dad65f4d1f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44', 'volume_size': 2} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1555094970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604783f2-cf7c-4c65-9bcf-dad65f4d1f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baee198c78a746a4b9f5592e7308c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:14:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:14:30Z,use_quota=True,user_id='b71c16b1b811488bac40a4b9f195a938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Creating volume 604783f2-cf7c-4c65-9bcf-dad65f4d1f44 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:14:30 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44 2147483648 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:30 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44 2147483648 Feb 26 03:14:30 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:30 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44 2147483648" returned: 0 in 0.470s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:30 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44 Feb 26 03:14:30 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:30 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44" returned: 0 in 0.388s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9ec1dd-896d-45c3-a97e-8a80582563a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44', 'volume_size': 2}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745d96a4-975a-406f-932e-503e95519b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:31 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Volume volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44 (604783f2-cf7c-4c65-9bcf-dad65f4d1f44): created successfully Feb 26 03:14:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745d96a4-975a-406f-932e-503e95519b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Flow 'volume_create_manager' (9a8a5db9-73a9-4a1f-b195-63c696c9614b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:14:31 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4e9eebf8-2f4f-40cb-b304-7604634065ae tempest-VolumesCloneNegativeTest-662414850 None] Created volume successfully. Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:32 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:14:32 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Acquiring lock "cinder-604783f2-cf7c-4c65-9bcf-dad65f4d1f44-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Lock "cinder-604783f2-cf7c-4c65-9bcf-dad65f4d1f44-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Acquiring lock "cinder-quobyte-604783f2-cf7c-4c65-9bcf-dad65f4d1f44" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Lock "cinder-quobyte-604783f2-cf7c-4c65-9bcf-dad65f4d1f44" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7718f88b-bb9f-42c2-a788-5c9e3c3e4840]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:32 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44 Feb 26 03:14:32 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:32 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.460s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:14:32 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44" returned: 0 in 0.443s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:32 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44 Feb 26 03:14:32 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:33 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-604783f2-cf7c-4c65-9bcf-dad65f4d1f44" returned: 0 in 0.397s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Lock "cinder-quobyte-604783f2-cf7c-4c65-9bcf-dad65f4d1f44" released by "delete_volume" :: held 0.862s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Created reservations ['e596699b-aa4b-42f2-8758-4773e6da6953', '48c8982f-e515-43c9-8762-4185c07c44f0', '53fcb5d1-7e1d-4dce-bb41-9a8a1d36e9dc', 'e9bd7722-0163-4b76-b5b2-e477e7d7afa3'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:33 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:14:33 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:33 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.449s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:14:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Deleted volume successfully. Feb 26 03:14:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e53908b3-ae13-4ede-a1b3-f3ada638b837 tempest-VolumesCloneNegativeTest-662414850 None] Lock "cinder-604783f2-cf7c-4c65-9bcf-dad65f4d1f44-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Flow 'volume_create_manager' (be68ffbc-d9e0-4cbc-ac48-0ad4ee61b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23ec9c6-e81b-4d15-955e-e360fd13a910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23ec9c6-e81b-4d15-955e-e360fd13a910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-900522008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc2ef7b-0391-4129-a91f-071d1e40eff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67444ea53ab4e8c86b021a971ed8c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:14:42Z,use_quota=True,user_id='17bf4879879746ae8d69259fd287248b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4875885-2b7c-4ee1-b308-8ec3aa9e2c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4875885-2b7c-4ee1-b308-8ec3aa9e2c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9095575-3738-49fb-a0b4-97aa8393143f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9095575-3738-49fb-a0b4-97aa8393143f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffc2ef7b-0391-4129-a91f-071d1e40eff1', 'volume_name': 'volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd686fc1-1be4-4786-b63e-7b1c337f0e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd686fc1-1be4-4786-b63e-7b1c337f0e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19754641-ad6b-41e1-a651-7ca2559c5a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:41 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume ffc2ef7b-0391-4129-a91f-071d1e40eff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1', 'volume_size': 1} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-900522008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc2ef7b-0391-4129-a91f-071d1e40eff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67444ea53ab4e8c86b021a971ed8c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:14:42Z,use_quota=True,user_id='17bf4879879746ae8d69259fd287248b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Creating volume ffc2ef7b-0391-4129-a91f-071d1e40eff1 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:14:41 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:14:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:41 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 1073741824 Feb 26 03:14:41 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:42 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 1073741824" returned: 0 in 0.486s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:42 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 Feb 26 03:14:42 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:42 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1" returned: 0 in 0.399s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:14:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19754641-ad6b-41e1-a651-7ca2559c5a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971b898d-f66d-426f-bd32-027f35447c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:42 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 (ffc2ef7b-0391-4129-a91f-071d1e40eff1): created successfully Feb 26 03:14:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971b898d-f66d-426f-bd32-027f35447c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Flow 'volume_create_manager' (be68ffbc-d9e0-4cbc-ac48-0ad4ee61b783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:14:42 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8102194c-3c29-496b-bb4d-d76c812ee5d8 tempest-VolumesSnapshotTestJSON-1046940038 None] Created volume successfully. Feb 26 03:14:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Creating offline snapshot 60787763-7fdf-4dda-9479-0bf1c774e695 of volume ffc2ef7b-0391-4129-a91f-071d1e40eff1 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:14:44 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4305876-5a7b-4aa6-8e27-73d84d3097bf]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:44 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 Feb 26 03:14:44 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:44 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1" returned: 0 in 0.494s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:44 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 1G Feb 26 03:14:44 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:45 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 1G" returned: 0 in 0.457s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:45 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 Feb 26 03:14:45 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:45 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695" returned: 0 in 0.433s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:45 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 is being set with open permissions: ugo+rw Feb 26 03:14:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:45 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 Feb 26 03:14:45 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:45 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695" returned: 0 in 0.378s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:45 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.info Feb 26 03:14:45 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:46 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.info" returned: 0 in 0.404s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:46 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.info is being set with open permissions: ugo+rw Feb 26 03:14:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:46 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.info Feb 26 03:14:46 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:46 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.info" returned: 0 in 0.400s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.621s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:46 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8ca137da-f35f-4f15-a9b3-e43d06554df9 tempest-VolumesSnapshotTestJSON-1046940038 None] Create snapshot completed successfully Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-60787763-7fdf-4dda-9479-0bf1c774e695-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-60787763-7fdf-4dda-9479-0bf1c774e695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-ffc2ef7b-0391-4129-a91f-071d1e40eff1" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-ffc2ef7b-0391-4129-a91f-071d1e40eff1" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-60787763-7fdf-4dda-9479-0bf1c774e695" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-60787763-7fdf-4dda-9479-0bf1c774e695" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Deleting offline snapshot 60787763-7fdf-4dda-9479-0bf1c774e695 of volume ffc2ef7b-0391-4129-a91f-071d1e40eff1 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] snapshot_file for this snap is: volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3c96a9-3aa8-4046-9600-e3da9ff74ced]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:47 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 Feb 26 03:14:47 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:47 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695" returned: 0 in 0.479s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[176eec96-5bcc-43c5-a121-5c720e40f191]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:47 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 Feb 26 03:14:47 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:48 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1" returned: 0 in 0.452s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:48 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 Feb 26 03:14:48 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:48 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695" returned: 0 in 0.432s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:48 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695 Feb 26 03:14:48 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:49 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1.60787763-7fdf-4dda-9479-0bf1c774e695" returned: 0 in 0.423s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-60787763-7fdf-4dda-9479-0bf1c774e695" released by "_delete_snapshot" :: held 1.849s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-ffc2ef7b-0391-4129-a91f-071d1e40eff1" released by "delete_snapshot" :: held 1.861s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Created reservations ['40989fb2-85bd-488f-94cd-eada3a65c179', '48b2ac64-a65f-4f0c-99d8-1bd66f5d0d60', '1e3eadd3-04f5-4629-b022-7ca888b08cda', '1dc3d99e-ab1c-4f09-87d1-666d1fb23518'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:14:49 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Delete snapshot completed successfully. Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9255cd59-71a6-4d14-86ff-88b53da5effa tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-60787763-7fdf-4dda-9479-0bf1c774e695-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Flow 'volume_create_manager' (e1bc6916-dcbd-4765-b308-b084824d3940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e943d1ae-c05b-4768-ab84-cee7f2378dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e943d1ae-c05b-4768-ab84-cee7f2378dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-79801870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732add4f-0d06-4e22-91bb-3dff5548b3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67444ea53ab4e8c86b021a971ed8c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:14:50Z,use_quota=True,user_id='17bf4879879746ae8d69259fd287248b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac839920-c312-458d-bd0d-e861a808ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac839920-c312-458d-bd0d-e861a808ead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e70c50-02d8-44d8-a3b8-e319b703f4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e70c50-02d8-44d8-a3b8-e319b703f4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732add4f-0d06-4e22-91bb-3dff5548b3d9', 'volume_name': 'volume-732add4f-0d06-4e22-91bb-3dff5548b3d9', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681ad00d-9a69-44c6-92ab-9e1da83d98b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681ad00d-9a69-44c6-92ab-9e1da83d98b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745f8194-1c76-489d-9bbb-531274789c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:49 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Volume 732add4f-0d06-4e22-91bb-3dff5548b3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732add4f-0d06-4e22-91bb-3dff5548b3d9', 'volume_size': 1} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-79801870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732add4f-0d06-4e22-91bb-3dff5548b3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67444ea53ab4e8c86b021a971ed8c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:14:50Z,use_quota=True,user_id='17bf4879879746ae8d69259fd287248b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Creating volume 732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:14:49 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:14:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:49 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 1073741824 Feb 26 03:14:49 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:50 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 1073741824" returned: 0 in 0.491s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:50 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 Feb 26 03:14:50 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:50 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:14:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:50 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745f8194-1c76-489d-9bbb-531274789c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732add4f-0d06-4e22-91bb-3dff5548b3d9', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:50 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd57bfc8-2f98-47d3-99f7-c4d6bcb5bfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:50 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Volume volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 (732add4f-0d06-4e22-91bb-3dff5548b3d9): created successfully Feb 26 03:14:50 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd57bfc8-2f98-47d3-99f7-c4d6bcb5bfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:50 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Flow 'volume_create_manager' (e1bc6916-dcbd-4765-b308-b084824d3940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:14:50 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a16f0b1e-bd79-4425-b253-d2418bdc7a6d tempest-VolumesSnapshotTestJSON-1046940038 None] Created volume successfully. Feb 26 03:14:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Creating offline snapshot 336de379-55c7-4bc6-87ca-830f20779ca7 of volume 732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:14:51 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[076aab89-714e-43f6-a8d8-7e47d955cbda]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:51 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 Feb 26 03:14:51 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:52 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9" returned: 0 in 0.463s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:52 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 1G Feb 26 03:14:52 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:52 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 1G" returned: 0 in 0.460s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:52 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 Feb 26 03:14:52 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:53 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7" returned: 0 in 0.411s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:53 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 is being set with open permissions: ugo+rw Feb 26 03:14:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:53 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 Feb 26 03:14:53 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:53 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7" returned: 0 in 0.412s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:53 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.info Feb 26 03:14:53 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:54 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.info" returned: 0 in 0.416s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:54 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.info is being set with open permissions: ugo+rw Feb 26 03:14:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:54 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.info Feb 26 03:14:54 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:54 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.info" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-06cd94c9-d0f5-413f-a83d-69455857c994 tempest-VolumesSnapshotTestJSON-1046940038 None] Create snapshot completed successfully Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Flow 'volume_create_manager' (5862993e-c425-4d9e-a2c5-6051f7a42a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c4603d-918e-449c-8ce2-284d30019991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c4603d-918e-449c-8ce2-284d30019991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1885124912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0fe575-0f1a-40d4-aa28-758bcde2ebe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67444ea53ab4e8c86b021a971ed8c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:14:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=336de379-55c7-4bc6-87ca-830f20779ca7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:14:55Z,use_quota=True,user_id='17bf4879879746ae8d69259fd287248b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503d82dd-6f8f-461b-8ad3-ff348c57ab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503d82dd-6f8f-461b-8ad3-ff348c57ab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9120c85-d0ce-465b-987e-41628899654c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9120c85-d0ce-465b-987e-41628899654c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f0fe575-0f1a-40d4-aa28-758bcde2ebe0', 'volume_name': 'volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0', 'volume_size': 2, 'snapshot_id': '336de379-55c7-4bc6-87ca-830f20779ca7'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11899afd-0b6d-4dac-ab4a-33b815dcecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11899afd-0b6d-4dac-ab4a-33b815dcecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef463a8-7883-4f1f-bf1d-f538f6679dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:55 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume 0f0fe575-0f1a-40d4-aa28-758bcde2ebe0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0', 'volume_size': 2, 'snapshot_id': '336de379-55c7-4bc6-87ca-830f20779ca7'} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-336de379-55c7-4bc6-87ca-830f20779ca7-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" by "_create_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-336de379-55c7-4bc6-87ca-830f20779ca7-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Creating volume 0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 from snapshot 336de379-55c7-4bc6-87ca-830f20779ca7 {{(pid=83121) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] snapshot: 336de379-55c7-4bc6-87ca-830f20779ca7, volume: 0f0fe575-0f1a-40d4-aa28-758bcde2ebe0, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9147e2-4c35-4c06-9077-28bc88f6ca23]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:55 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 Feb 26 03:14:55 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:55 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-732add4f-0d06-4e22-91bb-3dff5548b3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2495ae99-07b7-4437-bd8f-da27da7f28ff]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:55 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 Feb 26 03:14:55 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:56 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9" returned: 0 in 0.473s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:56 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:14:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:56 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 Feb 26 03:14:56 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:58 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" returned: 0 in 1.911s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:58 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04957d-2c37-415f-ad5f-1f439388dbda]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:58 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 Feb 26 03:14:58 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:58 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9" returned: 0 in 0.602s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:58 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:14:58 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Converted 1024.00 MB image at 535.33 MB/s Feb 26 03:14:58 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 is being set with open permissions: ugo+rw Feb 26 03:14:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:58 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 Feb 26 03:14:58 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:14:59 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" released by "_copy_volume_from_snapshot" :: held 3.878s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-336de379-55c7-4bc6-87ca-830f20779ca7-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" released by "_create_volume_from_snapshot" :: held 3.894s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.905s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef463a8-7883-4f1f-bf1d-f538f6679dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0', 'volume_size': 2, 'snapshot_id': '336de379-55c7-4bc6-87ca-830f20779ca7'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc307a90-f73b-48c2-a01a-45888b8fa8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:14:59 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 (0f0fe575-0f1a-40d4-aa28-758bcde2ebe0): created successfully Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc307a90-f73b-48c2-a01a-45888b8fa8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Flow 'volume_create_manager' (5862993e-c425-4d9e-a2c5-6051f7a42a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:14:59 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5c88d9c9-446a-4d26-b2c1-aa5f5f9b1c81 tempest-VolumesSnapshotTestJSON-1046940038 None] Created volume successfully. Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5c03bc-5fc8-47ca-b268-07407fec3b97]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:14:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:14:59 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 Feb 26 03:14:59 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:00 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:00 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0 Feb 26 03:15:00 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:00 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" returned: 0 in 0.387s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0" released by "delete_volume" :: held 0.874s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=44,cinder:UPDATE=37,cinder:INSERT=13,cinder:DELETE=4 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Created reservations ['88779ef7-6ec5-471d-b744-c90c519411e8', 'e0d54fe4-0b40-47f9-95d6-f7d12e5f5102', 'f5060c09-6342-452e-a5f7-ae13a8b146bf', '3885632c-75d2-449a-b66b-acc5bafb166a'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:00 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:15:00 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-336de379-55c7-4bc6-87ca-830f20779ca7-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-336de379-55c7-4bc6-87ca-830f20779ca7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-732add4f-0d06-4e22-91bb-3dff5548b3d9" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-732add4f-0d06-4e22-91bb-3dff5548b3d9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-336de379-55c7-4bc6-87ca-830f20779ca7" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-336de379-55c7-4bc6-87ca-830f20779ca7" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Deleting offline snapshot 336de379-55c7-4bc6-87ca-830f20779ca7 of volume 732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] snapshot_file for this snap is: volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f1a46a-e6f3-493e-aac3-189b4924fe72]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:00 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 Feb 26 03:15:00 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:00 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.432s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:00 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:15:01 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Deleted volume successfully. Feb 26 03:15:01 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e4f6f09c-7e0f-4799-b433-19d9e429e458 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-0f0fe575-0f1a-40d4-aa28-758bcde2ebe0-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:01 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7" returned: 0 in 0.517s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-732add4f-0d06-4e22-91bb-3dff5548b3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:15:01 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4101d722-b0e1-4167-8d98-0a49ac061f2a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:01 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 Feb 26 03:15:01 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:01 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9" returned: 0 in 0.444s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:01 devstack sudo[87744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 Feb 26 03:15:01 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:02 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7" returned: 0 in 0.430s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:02 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7 Feb 26 03:15:02 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:02 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9.336de379-55c7-4bc6-87ca-830f20779ca7" returned: 0 in 0.393s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-336de379-55c7-4bc6-87ca-830f20779ca7" released by "_delete_snapshot" :: held 1.836s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-732add4f-0d06-4e22-91bb-3dff5548b3d9" released by "delete_snapshot" :: held 1.847s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Created reservations ['bd507852-5809-4af7-9c5d-02318c6d3dbd', 'cc8df531-cff7-4cbc-afe0-e795b4b0d70b', '69a14175-a85f-457c-b636-22d8caf38f19', 'f124b1cd-e0ec-429a-9720-0614575f9fe5'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:15:02 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Delete snapshot completed successfully. Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-df6cc5ae-cf5e-4c47-942c-f300d6098f52 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-336de379-55c7-4bc6-87ca-830f20779ca7-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-732add4f-0d06-4e22-91bb-3dff5548b3d9-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-732add4f-0d06-4e22-91bb-3dff5548b3d9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-732add4f-0d06-4e22-91bb-3dff5548b3d9" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-732add4f-0d06-4e22-91bb-3dff5548b3d9" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6433abb-f3af-427e-aa18-fbd072822107]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:03 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 Feb 26 03:15:03 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:03 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9" returned: 0 in 0.468s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:03 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9 Feb 26 03:15:03 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:03 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-732add4f-0d06-4e22-91bb-3dff5548b3d9" returned: 0 in 0.386s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-732add4f-0d06-4e22-91bb-3dff5548b3d9" released by "delete_volume" :: held 0.895s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Created reservations ['c37234f0-4fa3-4c28-a441-925eea2874c0', 'bcc57e4f-c659-4b6f-b430-24aa86fad956', '2f734d6a-f505-4ce2-933e-f13f52cb7d56', 'f4271508-c99b-47d4-828a-c9daeca90907'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:03 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:15:03 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Flow 'volume_create_manager' (c3144bec-cac0-4b6c-8405-ff2cb2410521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b696482a-9517-4137-99b2-42f9c92df91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b696482a-9517-4137-99b2-42f9c92df91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1332630310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee3d699-7fa3-4d5b-9706-14155c4278a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67444ea53ab4e8c86b021a971ed8c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:15:04Z,use_quota=True,user_id='17bf4879879746ae8d69259fd287248b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b022693-562c-4510-b801-2b4fca6984ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b022693-562c-4510-b801-2b4fca6984ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ddcc78-eecc-4a09-9b3b-e59c1b1b7ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ddcc78-eecc-4a09-9b3b-e59c1b1b7ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee3d699-7fa3-4d5b-9706-14155c4278a9', 'volume_name': 'volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4021d26-382b-4bcf-97b9-cc42d354dd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4021d26-382b-4bcf-97b9-cc42d354dd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:04 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29eeb32d-d32c-4112-a592-f20f2bbc437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:04 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume 2ee3d699-7fa3-4d5b-9706-14155c4278a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9', 'volume_size': 1} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1332630310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee3d699-7fa3-4d5b-9706-14155c4278a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67444ea53ab4e8c86b021a971ed8c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:15:04Z,use_quota=True,user_id='17bf4879879746ae8d69259fd287248b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Creating volume 2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:15:04 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.540s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:15:04 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Deleted volume successfully. Feb 26 03:15:04 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 1073741824 Feb 26 03:15:04 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de6d5833-95fc-40ed-9b96-8d5b0e0b88f3 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-732add4f-0d06-4e22-91bb-3dff5548b3d9-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:04 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 1073741824" returned: 0 in 0.460s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:04 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 Feb 26 03:15:04 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:05 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9" returned: 0 in 0.421s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:15:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29eeb32d-d32c-4112-a592-f20f2bbc437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1915e44c-fedb-4c89-bf46-5332a6685318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:05 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 (2ee3d699-7fa3-4d5b-9706-14155c4278a9): created successfully Feb 26 03:15:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1915e44c-fedb-4c89-bf46-5332a6685318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Flow 'volume_create_manager' (c3144bec-cac0-4b6c-8405-ff2cb2410521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:15:05 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-ec72a3bf-d28e-4c65-9c05-652feb7d4f40 tempest-VolumesSnapshotTestJSON-1046940038 None] Created volume successfully. Feb 26 03:15:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:06 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Creating offline snapshot 14afce41-a6e9-4d6e-b312-ac98fac364d6 of volume 2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:15:06 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58d7d1-15c1-4c3e-b2f9-09a70ee5668c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:06 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 Feb 26 03:15:06 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:07 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9" returned: 0 in 0.479s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:07 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 1G Feb 26 03:15:07 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:07 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 1G" returned: 0 in 0.444s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:07 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 Feb 26 03:15:07 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:07 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6" returned: 0 in 0.409s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:07 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 is being set with open permissions: ugo+rw Feb 26 03:15:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:07 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 Feb 26 03:15:07 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:08 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6" returned: 0 in 0.399s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:08 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.info Feb 26 03:15:08 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:08 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.info" returned: 0 in 0.403s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:08 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.info is being set with open permissions: ugo+rw Feb 26 03:15:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:08 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.info Feb 26 03:15:08 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:09 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.info" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.580s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:09 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-7f6f1516-f85a-4549-893a-24225b99a989 tempest-VolumesSnapshotTestJSON-1046940038 None] Create snapshot completed successfully Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Flow 'volume_create_manager' (d5d67af9-b1b6-405d-b4c7-4449db9082d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a08c65-a6b6-486b-b627-fa13faf3ffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a08c65-a6b6-486b-b627-fa13faf3ffaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-170509556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ec5f56-408d-4374-b3dd-30981d63fb1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67444ea53ab4e8c86b021a971ed8c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=14afce41-a6e9-4d6e-b312-ac98fac364d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:15:10Z,use_quota=True,user_id='17bf4879879746ae8d69259fd287248b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d494e47c-be05-4c27-9656-cd9e38ab54fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d494e47c-be05-4c27-9656-cd9e38ab54fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07449966-ba2e-4ca4-b471-74042fbf002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07449966-ba2e-4ca4-b471-74042fbf002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd2ec5f56-408d-4374-b3dd-30981d63fb1b', 'volume_name': 'volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b', 'volume_size': 1, 'snapshot_id': '14afce41-a6e9-4d6e-b312-ac98fac364d6'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c6847b-01c9-446a-87c7-476f149fa0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c6847b-01c9-446a-87c7-476f149fa0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d9c96e-2bb7-4488-a186-c1cce3ebcc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:09 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume d2ec5f56-408d-4374-b3dd-30981d63fb1b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b', 'volume_size': 1, 'snapshot_id': '14afce41-a6e9-4d6e-b312-ac98fac364d6'} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-14afce41-a6e9-4d6e-b312-ac98fac364d6-d2ec5f56-408d-4374-b3dd-30981d63fb1b" by "_create_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-14afce41-a6e9-4d6e-b312-ac98fac364d6-d2ec5f56-408d-4374-b3dd-30981d63fb1b" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Creating volume d2ec5f56-408d-4374-b3dd-30981d63fb1b from snapshot 14afce41-a6e9-4d6e-b312-ac98fac364d6 {{(pid=83121) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-d2ec5f56-408d-4374-b3dd-30981d63fb1b" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-d2ec5f56-408d-4374-b3dd-30981d63fb1b" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] snapshot: 14afce41-a6e9-4d6e-b312-ac98fac364d6, volume: d2ec5f56-408d-4374-b3dd-30981d63fb1b, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d61d42-a35d-4e07-b9c9-4ff9f2444a75]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:10 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 Feb 26 03:15:10 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:10 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6" returned: 0 in 0.471s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[70855167-c882-4f8c-8c65-bfe90519a1f2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:10 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 Feb 26 03:15:10 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:10 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9" returned: 0 in 0.476s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:15:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:11 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b Feb 26 03:15:11 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:12 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b" returned: 0 in 1.949s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:12 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0e90b7-62a0-4520-ad04-988ff939ffa3]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:13 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 Feb 26 03:15:13 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:13 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9" returned: 0 in 0.580s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:15:13 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Converted 1024.00 MB image at 524.96 MB/s Feb 26 03:15:13 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b is being set with open permissions: ugo+rw Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:13 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b Feb 26 03:15:13 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:13 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b" returned: 0 in 0.389s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-d2ec5f56-408d-4374-b3dd-30981d63fb1b" released by "_copy_volume_from_snapshot" :: held 3.918s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-14afce41-a6e9-4d6e-b312-ac98fac364d6-d2ec5f56-408d-4374-b3dd-30981d63fb1b" released by "_create_volume_from_snapshot" :: held 3.939s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.947s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=70,cinder:SELECT=70,cinder:DELETE=6,cinder:INSERT=11 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d9c96e-2bb7-4488-a186-c1cce3ebcc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b', 'volume_size': 1, 'snapshot_id': '14afce41-a6e9-4d6e-b312-ac98fac364d6'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc15e5a7-e7ad-4d57-8415-4f89bd2cdfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:13 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Volume volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b (d2ec5f56-408d-4374-b3dd-30981d63fb1b): created successfully Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc15e5a7-e7ad-4d57-8415-4f89bd2cdfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Flow 'volume_create_manager' (d5d67af9-b1b6-405d-b4c7-4449db9082d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:15:13 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-ed875054-dc50-490d-92f2-451936fac273 tempest-VolumesSnapshotTestJSON-1046940038 None] Created volume successfully. Feb 26 03:15:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-d2ec5f56-408d-4374-b3dd-30981d63fb1b-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-d2ec5f56-408d-4374-b3dd-30981d63fb1b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-d2ec5f56-408d-4374-b3dd-30981d63fb1b" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-d2ec5f56-408d-4374-b3dd-30981d63fb1b" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:14 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee911d0-0811-47ad-8cd3-0f4aad183c45]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:14 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b Feb 26 03:15:14 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:14 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b" returned: 0 in 0.451s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:14 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b Feb 26 03:15:14 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:15 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-d2ec5f56-408d-4374-b3dd-30981d63fb1b" returned: 0 in 0.385s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-d2ec5f56-408d-4374-b3dd-30981d63fb1b" released by "delete_volume" :: held 0.861s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Created reservations ['4d0687a4-d55f-415d-b635-d0174ae60b3a', '08b21796-24fc-40af-9acc-2d0fc099f200', '3e44e8d2-828d-4943-9cc8-a3b686889a60', 'ed72bbc1-1359-4684-bf56-660f50245c46'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:15 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:15:15 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-14afce41-a6e9-4d6e-b312-ac98fac364d6-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-14afce41-a6e9-4d6e-b312-ac98fac364d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-2ee3d699-7fa3-4d5b-9706-14155c4278a9" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-2ee3d699-7fa3-4d5b-9706-14155c4278a9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-14afce41-a6e9-4d6e-b312-ac98fac364d6" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-14afce41-a6e9-4d6e-b312-ac98fac364d6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Deleting offline snapshot 14afce41-a6e9-4d6e-b312-ac98fac364d6 of volume 2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] snapshot_file for this snap is: volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[47af7b45-f535-4155-9b19-1dc7204e3bae]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:15 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 Feb 26 03:15:15 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:15 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.420s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:15:15 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Deleted volume successfully. Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29a36173-058a-4df5-a1af-e23a3ba06344 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-d2ec5f56-408d-4374-b3dd-30981d63fb1b-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:15 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6" returned: 0 in 0.452s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5e3ce-b3cf-456b-8f12-84b64db64a27]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:15 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 Feb 26 03:15:15 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:16 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9" returned: 0 in 0.472s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:16 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 Feb 26 03:15:16 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:16 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6" returned: 0 in 0.453s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:16 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6 Feb 26 03:15:16 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:17 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9.14afce41-a6e9-4d6e-b312-ac98fac364d6" returned: 0 in 0.396s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-14afce41-a6e9-4d6e-b312-ac98fac364d6" released by "_delete_snapshot" :: held 1.822s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-2ee3d699-7fa3-4d5b-9706-14155c4278a9" released by "delete_snapshot" :: held 1.833s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Created reservations ['a9f5235a-1b36-4ec0-8103-d33715bd8754', '6d5b2ca0-9247-4610-8e89-8de12cde3850', 'ac1814d3-b138-4edc-b3f0-b697f93b489a', '61faeedc-e886-49c6-a6ab-bb1638daf5db'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:15:17 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Delete snapshot completed successfully. Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-1d2b5b94-dafe-47ae-bcd1-e4dd60382802 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-14afce41-a6e9-4d6e-b312-ac98fac364d6-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-2ee3d699-7fa3-4d5b-9706-14155c4278a9-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-2ee3d699-7fa3-4d5b-9706-14155c4278a9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-2ee3d699-7fa3-4d5b-9706-14155c4278a9" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-2ee3d699-7fa3-4d5b-9706-14155c4278a9" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[535d1858-af53-45ed-a8d9-47b9825841c2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:17 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 Feb 26 03:15:17 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:18 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9" returned: 0 in 0.451s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:18 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9 Feb 26 03:15:18 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:18 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2ee3d699-7fa3-4d5b-9706-14155c4278a9" returned: 0 in 0.396s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-2ee3d699-7fa3-4d5b-9706-14155c4278a9" released by "delete_volume" :: held 0.883s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Created reservations ['d3e5c68b-c418-4d61-b183-5c4f46d08fba', 'eebd31af-f28d-4a5d-abc9-dd7600df8c7e', 'cae327aa-f58b-4eb8-93d1-6de8194c8385', 'd5660dc9-44dc-4b7e-8d9a-db5b5e86005c'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:18 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:15:18 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-ffc2ef7b-0391-4129-a91f-071d1e40eff1-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-ffc2ef7b-0391-4129-a91f-071d1e40eff1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "cinder-quobyte-ffc2ef7b-0391-4129-a91f-071d1e40eff1" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-ffc2ef7b-0391-4129-a91f-071d1e40eff1" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1219c16a-280f-464a-a7ce-08b77c751cc0]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:18 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 Feb 26 03:15:18 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:18 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.470s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:18 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:15:18 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Deleted volume successfully. Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-640fc48e-3dc8-482e-86a2-f4a284bc7e7a tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-2ee3d699-7fa3-4d5b-9706-14155c4278a9-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:19 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1" returned: 0 in 0.470s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:19 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1 Feb 26 03:15:19 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:19 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-ffc2ef7b-0391-4129-a91f-071d1e40eff1" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-quobyte-ffc2ef7b-0391-4129-a91f-071d1e40eff1" released by "delete_volume" :: held 0.905s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Created reservations ['88d088a1-dd3b-4dd8-b9de-51b63ec7d0c4', '5e171509-ec1b-4e7d-a872-259532a963b5', '077abf2f-ffcf-48a6-983e-48a0893ce5d2', 'c8956dcb-a3af-4190-ad03-1158dcb31a5f'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:19 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:15:19 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:20 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.422s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:20 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:15:20 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Deleted volume successfully. Feb 26 03:15:20 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6d99b886-e9d2-48e6-ba40-f01a6052ffb1 tempest-VolumesSnapshotTestJSON-1046940038 None] Lock "cinder-ffc2ef7b-0391-4129-a91f-071d1e40eff1-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:15:29 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:INSERT=15,cinder:UPDATE=55,cinder:DELETE=3,cinder:SELECT=37 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:15:30 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:DELETE=3,cinder:SELECT=19,cinder:INSERT=8,cinder:UPDATE=28 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:15:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:15:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:15:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:15:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:32 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:15:32 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:32 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Flow 'volume_create_manager' (898c139f-cf68-41f5-9f1f-f56a2066f78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebddc62-3227-4203-994d-9fdd75376a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebddc62-3227-4203-994d-9fdd75376a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1831704910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5dd492c-b270-4bc4-8879-bed3017fee68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc7b041580d4fdba7d783617bc3f723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:15:37Z,use_quota=True,user_id='910effd893664d9f928c711d3672a4ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d807f3-3d41-4193-9079-5cd79d895620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d807f3-3d41-4193-9079-5cd79d895620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00879bd-692a-4799-a787-7322121f07b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.image.glance [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Creating Keystone auth plugin from conf {{(pid=83121) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00879bd-692a-4799-a787-7322121f07b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5dd492c-b270-4bc4-8879-bed3017fee68', 'volume_name': 'volume-c5dd492c-b270-4bc4-8879-bed3017fee68', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4fa736-861f-4f35-a96b-313029aa4265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4fa736-861f-4f35-a96b-313029aa4265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39efa52e-67d4-478a-a7f4-351738cb71a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:36 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Volume c5dd492c-b270-4bc4-8879-bed3017fee68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5dd492c-b270-4bc4-8879-bed3017fee68', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 26 03:15:36 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Trying to clone c5dd492c-b270-4bc4-8879-bed3017fee68 from image 95c0faf7-23d7-4587-ab20-846f22462e10 at location (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]). {{(pid=83121) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 26 03:15:37 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 26 03:15:37 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Image download 20.69 MB at 20.69 MB/s Feb 26 03:15:37 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aaffe1-9886-44bf-a2df-b5e9845397fb]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:37 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD Feb 26 03:15:37 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:37 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:37 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Temporary image 95c0faf7-23d7-4587-ab20-846f22462e10 is fetched for user 910effd893664d9f928c711d3672a4ff. {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 26 03:15:37 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b390ed-caf7-46e1-b725-aab24eace955]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:37 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD Feb 26 03:15:37 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:38 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1831704910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5dd492c-b270-4bc4-8879-bed3017fee68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc7b041580d4fdba7d783617bc3f723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:15:37Z,use_quota=True,user_id='910effd893664d9f928c711d3672a4ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Creating volume c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:15:38 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:38 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 1073741824 Feb 26 03:15:38 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:38 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 1073741824" returned: 0 in 0.480s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:38 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 Feb 26 03:15:38 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:39 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68" returned: 0 in 0.400s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Attempting download of 95c0faf7-23d7-4587-ab20-846f22462e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}])) to volume c5dd492c-b270-4bc4-8879-bed3017fee68. {{(pid=83121) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3999a41-edb8-43da-b2e2-702ad2fcaeda]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_sz9v00cd {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:39 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_sz9v00cd Feb 26 03:15:39 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:39 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_sz9v00cd" returned: 0 in 0.441s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_sz9v00cd {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:39 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_sz9v00cd Feb 26 03:15:39 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:39 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_sz9v00cd" returned: 1 in 0.456s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95c0faf7-23d7-4587-ab20-846f22462e10_sz9v00cd' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f482f800-d2d0-465a-989c-09f74796c026]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:40 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD Feb 26 03:15:40 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:40 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD" returned: 0 in 0.430s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:40 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] 95c0faf7-23d7-4587-ab20-846f22462e10 was qcow2, converting to raw {{(pid=83121) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 26 03:15:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:40 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 Feb 26 03:15:40 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:41 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68" returned: 0 in 0.837s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:41 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_95c0faf7-23d7-4587-ab20-846f22462e10_ccowqaa_devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:15:41 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Converted 112.00 MB image at 112.00 MB/s Feb 26 03:15:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:41 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 1G Feb 26 03:15:41 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:41 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 1G" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:41 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[678be7ac-b8ae-4b2e-83db-b368e3ccb272]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:41 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 Feb 26 03:15:41 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:42 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68" returned: 0 in 0.482s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:42 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 Feb 26 03:15:42 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:42 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68" returned: 1 in 0.454s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Downloaded image 95c0faf7-23d7-4587-ab20-846f22462e10 ((None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}])) to volume c5dd492c-b270-4bc4-8879-bed3017fee68 successfully. {{(pid=83121) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Temporary image 95c0faf7-23d7-4587-ab20-846f22462e10 for user 910effd893664d9f928c711d3672a4ff is deleted. {{(pid=83121) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG cinder.volume.volume_utils [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Marking volume c5dd492c-b270-4bc4-8879-bed3017fee68 as bootable. {{(pid=83121) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Copying metadata from image 95c0faf7-23d7-4587-ab20-846f22462e10 to c5dd492c-b270-4bc4-8879-bed3017fee68. {{(pid=83121) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Creating volume glance metadata for volume c5dd492c-b270-4bc4-8879-bed3017fee68 backed by image 95c0faf7-23d7-4587-ab20-846f22462e10 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83121) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39efa52e-67d4-478a-a7f4-351738cb71a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5dd492c-b270-4bc4-8879-bed3017fee68', 'volume_size': 1, 'image_id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95c0faf7-23d7-4587-ab20-846f22462e10', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c130f56b716a4c96bba30e7a00a75416', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '95c0faf7-23d7-4587-ab20-846f22462e10', 'created_at': datetime.datetime(2026, 2, 26, 1, 57, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 1, 57, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95c0faf7-23d7-4587-ab20-846f22462e10/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e476b5dd-dd17-4d6d-ace5-ad179d6be6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:15:42 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Volume volume-c5dd492c-b270-4bc4-8879-bed3017fee68 (c5dd492c-b270-4bc4-8879-bed3017fee68): created successfully Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e476b5dd-dd17-4d6d-ace5-ad179d6be6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:15:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Flow 'volume_create_manager' (898c139f-cf68-41f5-9f1f-f56a2066f78e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:15:42 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-22546ab2-264c-4032-8e60-0bdb3520e4dc tempest-TestVolumeBootPattern-1667998092 None] Created volume successfully. Feb 26 03:15:52 devstack cinder-volume[83121]: WARNING py.warnings [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Feb 26 03:15:52 devstack cinder-volume[83121]: .first() Feb 26 03:15:52 devstack cinder-volume[83121]: Feb 26 03:15:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:15:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:15:52 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8770d2e-096f-463d-ac67-84f86ba48756]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:15:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:52 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 Feb 26 03:15:52 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:52 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=12,cinder:INSERT=9,cinder:UPDATE=4 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:15:52 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68" returned: 0 in 0.465s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:15:52 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 Feb 26 03:15:52 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:15:53 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Feb 26 03:15:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68" returned: 1 in 0.473s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:15:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:15:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.963s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:15:53 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d', 'name': 'volume-c5dd492c-b270-4bc4-8879-bed3017fee68', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '541cf861-7922-4e4d-99f2-585ad5c2ea7b', 'enforce_multipath': True} {{(pid=83121) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 26 03:15:53 devstack cinder-volume[83121]: INFO cinder.volume.manager [req-6463a2e2-c453-451b-845b-d33df157bf81 req-ec789fdc-e23d-458b-a095-9abf143047c0 tempest-TestVolumeBootPattern-1667998092 None] attachment_update completed successfully. Feb 26 03:16:03 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=6,cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:16:03 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:16:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:16:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:16:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:16:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:16:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:16:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:16:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:16:32 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:16:32 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:16:32 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Feb 26 03:16:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.428s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:16:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:17:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:17:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:17:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:17:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:17:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:17:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:17:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:17:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:17:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:17:32 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:17:32 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:17:32 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Feb 26 03:17:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.424s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:17:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:18:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:18:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:18:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:18:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:18:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:18:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:18:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:18:32 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:18:32 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:18:32 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Feb 26 03:18:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.391s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:18:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:19:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:19:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:19:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:19:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:19:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:19:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:19:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:19:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:19:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:19:32 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:19:32 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:19:32 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Feb 26 03:19:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.399s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:19:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:20:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:20:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:20:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:20:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:20:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:20:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:20:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:20:32 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:20:32 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:20:32 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Feb 26 03:20:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.376s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:20:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:00 devstack cinder-volume[83121]: INFO cinder.volume.manager [req-6463a2e2-c453-451b-845b-d33df157bf81 req-8e211b93-8a96-4283-87fb-d90207aa7c92 tempest-TestVolumeBootPattern-1667998092 None] Terminate volume connection completed successfully. Feb 26 03:21:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-6463a2e2-c453-451b-845b-d33df157bf81 req-8e211b93-8a96-4283-87fb-d90207aa7c92 tempest-TestVolumeBootPattern-1667998092 None] Deleting attachment 541cf861-7922-4e4d-99f2-585ad5c2ea7b. {{(pid=83121) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 26 03:21:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Acquiring lock "cinder-c5dd492c-b270-4bc4-8879-bed3017fee68-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Lock "cinder-c5dd492c-b270-4bc4-8879-bed3017fee68-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Acquiring lock "cinder-quobyte-c5dd492c-b270-4bc4-8879-bed3017fee68" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Lock "cinder-quobyte-c5dd492c-b270-4bc4-8879-bed3017fee68" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:06 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[06039e74-fcff-4466-a017-c402a7a5e799]: (4, 'raw') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:06 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 Feb 26 03:21:06 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:07 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68" returned: 0 in 0.481s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:07 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 Feb 26 03:21:07 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:07 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68" returned: 1 in 0.462s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68' failed. Not Retrying. {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 03:21:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:07 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68 Feb 26 03:21:07 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:08 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c5dd492c-b270-4bc4-8879-bed3017fee68" returned: 0 in 0.475s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Lock "cinder-quobyte-c5dd492c-b270-4bc4-8879-bed3017fee68" released by "delete_volume" :: held 1.462s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Created reservations ['396b2830-16ea-4922-bd47-6b43807809b1', 'b64e3808-5bda-4510-8efb-05af8f78299f', 'eae96c7f-e1da-4593-9d37-481f019a2f50', '8ed4702d-e2c9-4b83-85f0-2656c3a7c4cb'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:08 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:08 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:08 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.388s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:08 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Deleted volume successfully. Feb 26 03:21:08 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a693f7a8-4fdf-4a78-97cf-f7d7e79c771c tempest-TestVolumeBootPattern-1667998092 None] Lock "cinder-c5dd492c-b270-4bc4-8879-bed3017fee68-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (ec345eef-db98-4314-937d-fb700398b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933bde20-7404-46fa-8fc7-d85b16449b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933bde20-7404-46fa-8fc7-d85b16449b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1303903836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65825bb-6a37-48d0-8045-e0a78721646c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:15Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74a118a-1066-48c7-bd36-841e683b1521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74a118a-1066-48c7-bd36-841e683b1521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa419e1-ba78-4e73-b0cf-d8f67a43a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa419e1-ba78-4e73-b0cf-d8f67a43a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65825bb-6a37-48d0-8045-e0a78721646c', 'volume_name': 'volume-e65825bb-6a37-48d0-8045-e0a78721646c', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d25698f-d9da-49a1-823a-25095b843d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d25698f-d9da-49a1-823a-25095b843d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bb551b-abfd-4790-8541-f7debd3848e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:15 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume e65825bb-6a37-48d0-8045-e0a78721646c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65825bb-6a37-48d0-8045-e0a78721646c', 'volume_size': 1} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1303903836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65825bb-6a37-48d0-8045-e0a78721646c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:15Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Creating volume e65825bb-6a37-48d0-8045-e0a78721646c {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:15 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:15 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c 1073741824 Feb 26 03:21:15 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:15 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c 1073741824" returned: 0 in 0.435s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:15 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c Feb 26 03:21:15 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:16 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c" returned: 0 in 0.394s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bb551b-abfd-4790-8541-f7debd3848e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65825bb-6a37-48d0-8045-e0a78721646c', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2dc92b-bee0-4b94-ab4a-c874b6c25a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume volume-e65825bb-6a37-48d0-8045-e0a78721646c (e65825bb-6a37-48d0-8045-e0a78721646c): created successfully Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2dc92b-bee0-4b94-ab4a-c874b6c25a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (ec345eef-db98-4314-937d-fb700398b332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:16 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a934cc70-948a-4299-973f-ffce041f2614 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created volume successfully. Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (95688e19-9863-41be-a0b7-1fa27ef1aad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04bafbb-a53d-4637-9fe3-b71bd3094d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04bafbb-a53d-4637-9fe3-b71bd3094d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-632690688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:17Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecbd1d7-cc52-47f9-953b-6fc9982329a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecbd1d7-cc52-47f9-953b-6fc9982329a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43106771-7580-439c-8d1b-854f8fea4132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43106771-7580-439c-8d1b-854f8fea4132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2', 'volume_name': 'volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed03d267-eeca-425d-8a86-8011dc36037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed03d267-eeca-425d-8a86-8011dc36037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695e3957-8c0b-475b-bf77-ba768e0dbf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume 20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2', 'volume_size': 1} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-632690688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:17Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Creating volume 20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:16 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:16 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 1073741824 Feb 26 03:21:16 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (4fd50d0a-62aa-4add-9f90-21c7b6fec7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff44022-53bc-4fa8-b503-00db1f9ce9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff44022-53bc-4fa8-b503-00db1f9ce9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-187703403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b4d324-518d-470c-9eca-7688c4eb83b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:17Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5913e821-10fb-41f6-9f0f-9d6e6e529a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5913e821-10fb-41f6-9f0f-9d6e6e529a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a034a7-4db0-4b0a-b843-01ecd49ea0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a034a7-4db0-4b0a-b843-01ecd49ea0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b4d324-518d-470c-9eca-7688c4eb83b3', 'volume_name': 'volume-a1b4d324-518d-470c-9eca-7688c4eb83b3', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dbca61d-3a2a-4cc7-87fd-cfa81e2ae926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dbca61d-3a2a-4cc7-87fd-cfa81e2ae926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f5e13e-472c-4fe5-855a-1805f54f74a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:16 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume a1b4d324-518d-470c-9eca-7688c4eb83b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b4d324-518d-470c-9eca-7688c4eb83b3', 'volume_size': 1} Feb 26 03:21:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (cfc58c31-9c04-4344-99d3-9415f8462f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaabf68d-1fa4-4394-9aa8-b9539411b810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaabf68d-1fa4-4394-9aa8-b9539411b810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2113597465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b85509-51dc-4456-953f-58e28ee14a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:17Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14684c88-8dfc-4111-bdc7-c30a2a957966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14684c88-8dfc-4111-bdc7-c30a2a957966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ece2b6-c876-4764-81ce-07836ab72ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ece2b6-c876-4764-81ce-07836ab72ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b85509-51dc-4456-953f-58e28ee14a11', 'volume_name': 'volume-f9b85509-51dc-4456-953f-58e28ee14a11', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a833f0f6-471b-4c5e-a3b9-a724ebce7d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a833f0f6-471b-4c5e-a3b9-a724ebce7d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8bc70a3-2081-4a88-a6e4-2c38bd56624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume f9b85509-51dc-4456-953f-58e28ee14a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b85509-51dc-4456-953f-58e28ee14a11', 'volume_size': 1} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (8ed30e88-abf5-41d0-9d12-48edeedb3f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdc7224-454a-49ee-bd0e-60037c97b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdc7224-454a-49ee-bd0e-60037c97b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856734236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:17Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153a1440-02ea-47ea-a71b-46e278ae7ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153a1440-02ea-47ea-a71b-46e278ae7ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e36e011-e552-4b78-ab2c-d2e9a6abd1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e36e011-e552-4b78-ab2c-d2e9a6abd1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589', 'volume_name': 'volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ba4fa1-4c08-4359-8dc3-66b69bcffd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ba4fa1-4c08-4359-8dc3-66b69bcffd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3153fb42-7368-41f9-a9ad-416702c7cd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589', 'volume_size': 1} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:17 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 1073741824" returned: 0 in 0.570s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:17 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 Feb 26 03:21:17 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (008acec5-9480-4723-9cf7-6da360e0ac33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396a13bd-13c2-4f41-a8f4-5c7adffbb9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396a13bd-13c2-4f41-a8f4-5c7adffbb9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296435306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674aef2c-f292-43a5-bb82-2e047efa4716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:17Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62d0773-67fa-4811-8140-9a7c92293980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62d0773-67fa-4811-8140-9a7c92293980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0955ac3-6106-458f-98d4-991fc0dd8925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0955ac3-6106-458f-98d4-991fc0dd8925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '674aef2c-f292-43a5-bb82-2e047efa4716', 'volume_name': 'volume-674aef2c-f292-43a5-bb82-2e047efa4716', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ee3404-4b22-4796-a631-ed78fe112fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ee3404-4b22-4796-a631-ed78fe112fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0b5994-b819-4ca7-9eb3-ec80199175e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume 674aef2c-f292-43a5-bb82-2e047efa4716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-674aef2c-f292-43a5-bb82-2e047efa4716', 'volume_size': 1} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:17 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-187703403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b4d324-518d-470c-9eca-7688c4eb83b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:17Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Creating volume a1b4d324-518d-470c-9eca-7688c4eb83b3 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:17 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695e3957-8c0b-475b-bf77-ba768e0dbf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1032e088-cd5f-464b-8535-e1045c85a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:17 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3 1073741824 Feb 26 03:21:17 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:17 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 (20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2): created successfully Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1032e088-cd5f-464b-8535-e1045c85a324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (95688e19-9863-41be-a0b7-1fa27ef1aad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:17 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-75b1ce1b-9817-4ec5-be49-58c6cf136a31 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created volume successfully. Feb 26 03:21:18 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3 1073741824" returned: 0 in 0.440s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:18 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3 Feb 26 03:21:18 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:18 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2113597465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b85509-51dc-4456-953f-58e28ee14a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:17Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Creating volume f9b85509-51dc-4456-953f-58e28ee14a11 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:18 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f5e13e-472c-4fe5-855a-1805f54f74a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b4d324-518d-470c-9eca-7688c4eb83b3', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:18 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11 1073741824 Feb 26 03:21:18 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e3255d-8882-403f-876c-dc13002f62f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:18 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume volume-a1b4d324-518d-470c-9eca-7688c4eb83b3 (a1b4d324-518d-470c-9eca-7688c4eb83b3): created successfully Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e3255d-8882-403f-876c-dc13002f62f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (4fd50d0a-62aa-4add-9f90-21c7b6fec7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:18 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-87c03353-32da-4498-a984-91627078914a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created volume successfully. Feb 26 03:21:19 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11 1073741824" returned: 0 in 0.444s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:19 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11 Feb 26 03:21:19 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:19 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11" returned: 0 in 0.404s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.293s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856734236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:17Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Creating volume a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:19 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8bc70a3-2081-4a88-a6e4-2c38bd56624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b85509-51dc-4456-953f-58e28ee14a11', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:19 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 1073741824 Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de740fe5-024d-4709-bfcb-d45a56247856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:19 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:19 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume volume-f9b85509-51dc-4456-953f-58e28ee14a11 (f9b85509-51dc-4456-953f-58e28ee14a11): created successfully Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de740fe5-024d-4709-bfcb-d45a56247856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (cfc58c31-9c04-4344-99d3-9415f8462f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:19 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-d2740dfe-f25e-4bdc-a9e7-8ae2bd0fd547 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created volume successfully. Feb 26 03:21:20 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 1073741824" returned: 0 in 0.497s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:20 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 Feb 26 03:21:20 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:20 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589" returned: 0 in 0.382s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.948s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296435306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674aef2c-f292-43a5-bb82-2e047efa4716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b471d9cd294b429a093efa39e38677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:17Z,use_quota=True,user_id='b18ce1f25d2944d9b9e8ab4e3aaa6d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Creating volume 674aef2c-f292-43a5-bb82-2e047efa4716 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:20 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3153fb42-7368-41f9-a9ad-416702c7cd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:20 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716 1073741824 Feb 26 03:21:20 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a429502-ee8e-439f-85a8-2102f0b80908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:20 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 (a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589): created successfully Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a429502-ee8e-439f-85a8-2102f0b80908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (8ed30e88-abf5-41d0-9d12-48edeedb3f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:20 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e90425cc-f567-4e92-9e10-f8dbaf053832 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created volume successfully. Feb 26 03:21:21 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716 1073741824" returned: 0 in 0.500s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:21 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716 Feb 26 03:21:21 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:21 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716" returned: 0 in 0.382s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0b5994-b819-4ca7-9eb3-ec80199175e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-674aef2c-f292-43a5-bb82-2e047efa4716', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9d61fd-b3d6-4efb-9254-89cd6d2b99fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:21 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Volume volume-674aef2c-f292-43a5-bb82-2e047efa4716 (674aef2c-f292-43a5-bb82-2e047efa4716): created successfully Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9d61fd-b3d6-4efb-9254-89cd6d2b99fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Flow 'volume_create_manager' (008acec5-9480-4723-9cf7-6da360e0ac33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:21 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8749a3f6-d50d-4661-97c9-89aa90c2ca6a tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created volume successfully. Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-674aef2c-f292-43a5-bb82-2e047efa4716-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-674aef2c-f292-43a5-bb82-2e047efa4716-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-quobyte-674aef2c-f292-43a5-bb82-2e047efa4716" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-674aef2c-f292-43a5-bb82-2e047efa4716" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8acfb0-1c57-4feb-92f4-71f11c0951f2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:21 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716 Feb 26 03:21:21 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:22 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716" returned: 0 in 0.492s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:22 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716 Feb 26 03:21:22 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:22 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-674aef2c-f292-43a5-bb82-2e047efa4716" returned: 0 in 0.377s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-674aef2c-f292-43a5-bb82-2e047efa4716" released by "delete_volume" :: held 0.890s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created reservations ['242aa564-7417-402a-a845-28cd56fd9444', '30e44c4d-7026-487c-a91e-cce202a74704', '5300cd21-3a24-4a0c-b6de-94654881e24d', 'cd73008f-93df-4a0e-ac5a-12d2fa602c02'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:22 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:22 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-quobyte-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aa2112-f8c1-43f7-83d5-d9b8de9090bc]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:23 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 Feb 26 03:21:23 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:23 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:23 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Deleted volume successfully. Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f684fa15-1efc-460b-881e-f614391c850c tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-674aef2c-f292-43a5-bb82-2e047efa4716-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:23 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589" returned: 0 in 0.470s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:23 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589 Feb 26 03:21:23 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:23 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589" released by "delete_volume" :: held 0.880s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created reservations ['9a238ab2-5f92-4129-9a3f-ba846bd7de33', 'b9fe9743-1099-49ae-a5ba-4f07c62d487b', '1c073a3f-6404-4d8f-98e0-59f7eec41633', '974112aa-b1e3-442e-9331-5f730761fca5'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:23 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:23 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-f9b85509-51dc-4456-953f-58e28ee14a11-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-f9b85509-51dc-4456-953f-58e28ee14a11-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-quobyte-f9b85509-51dc-4456-953f-58e28ee14a11" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-f9b85509-51dc-4456-953f-58e28ee14a11" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8f9a1b-3892-4ec3-a943-6708d688a357]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:24 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11 Feb 26 03:21:24 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:24 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.414s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Deleted volume successfully. Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-40c43718-8309-491a-b9ae-ac94f671e3f0 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-a9b1ef67-3d9a-47e0-8bc9-fbff63dfa589-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:24 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11" returned: 0 in 0.495s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:24 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11 Feb 26 03:21:24 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:24 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f9b85509-51dc-4456-953f-58e28ee14a11" returned: 0 in 0.389s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-f9b85509-51dc-4456-953f-58e28ee14a11" released by "delete_volume" :: held 0.905s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created reservations ['e910b831-3c3a-4e7b-8e03-e34c28ecabe7', 'e62d2829-4e7f-4f85-b800-ec8a5acc9069', 'b7d064a3-0e4e-4455-a518-d924f0d0b9d1', '263802f6-96a5-47d8-b3af-e965de8f48a5'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:25 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:25 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-a1b4d324-518d-470c-9eca-7688c4eb83b3-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-a1b4d324-518d-470c-9eca-7688c4eb83b3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-quobyte-a1b4d324-518d-470c-9eca-7688c4eb83b3" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-a1b4d324-518d-470c-9eca-7688c4eb83b3" acquired by "delete_volume" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc80b18-d690-4034-9305-01815749eabf]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:25 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3 Feb 26 03:21:25 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:25 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.419s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:25 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Deleted volume successfully. Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0b83338-31bc-4d46-81df-67f7ae2e5468 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-f9b85509-51dc-4456-953f-58e28ee14a11-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:25 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3" returned: 0 in 0.490s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:25 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3 Feb 26 03:21:25 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:26 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a1b4d324-518d-470c-9eca-7688c4eb83b3" returned: 0 in 0.387s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-a1b4d324-518d-470c-9eca-7688c4eb83b3" released by "delete_volume" :: held 0.898s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created reservations ['d79e8f21-36d4-4ed5-b1d7-35ffb030bff3', '199e6cd2-5a97-45e1-9647-c21712717a6b', '035d1e60-c42c-475a-958a-743af21e8257', 'd4e470fa-7cef-4241-a658-fafb77743892'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:26 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:26 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-quobyte-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb174b1-4569-4bc1-8434-1e9c4e144e21]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:26 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 Feb 26 03:21:26 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:26 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.390s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Deleted volume successfully. Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-0123f8d8-2e8b-42f3-9a6e-05a7ec7e71d7 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-a1b4d324-518d-470c-9eca-7688c4eb83b3-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:26 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2" returned: 0 in 0.472s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:26 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2 Feb 26 03:21:26 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:27 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2" returned: 0 in 0.380s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2" released by "delete_volume" :: held 0.874s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created reservations ['89d2fde1-d980-40f7-949d-bfdcfcd5c816', '17850608-b26b-43c4-88a1-2bf753495e67', 'b3ff0e12-77bf-4a9f-b9bb-be85ee36a52c', 'e8ed4335-cf84-4947-ac0b-b8030f578889'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:27 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:27 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-e65825bb-6a37-48d0-8045-e0a78721646c-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-e65825bb-6a37-48d0-8045-e0a78721646c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "cinder-quobyte-e65825bb-6a37-48d0-8045-e0a78721646c" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-e65825bb-6a37-48d0-8045-e0a78721646c" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2972a-446e-4b03-aa20-2476240ce634]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:27 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c Feb 26 03:21:27 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:27 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.393s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:27 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Deleted volume successfully. Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2d235e15-ed52-4656-8f66-dc3d1911f17b tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-20f9f42c-1f7b-4a7f-a24e-96b3b323fdf2-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:27 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c" returned: 0 in 0.481s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:27 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c Feb 26 03:21:27 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:28 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e65825bb-6a37-48d0-8045-e0a78721646c" returned: 0 in 0.412s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-quobyte-e65825bb-6a37-48d0-8045-e0a78721646c" released by "delete_volume" :: held 0.916s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Created reservations ['59d23290-013f-4fe9-afd2-fab2465c29d6', '1bbd54a8-ddb1-4b48-9faf-b7e7f1a4eeb4', 'f471fd63-4804-4230-97e9-bc0457eed698', '04237257-375f-4d03-b9d0-ff28b3d20db1'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:28 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:28 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:28 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.432s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:28 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Deleted volume successfully. Feb 26 03:21:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7cbf72aa-b9a2-41c1-8753-b1aed2eadf11 tempest-CreateVolumesFromSourceVolumeTest-414220419 None] Lock "cinder-e65825bb-6a37-48d0-8045-e0a78721646c-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Flow 'volume_create_manager' (a3a031b9-01ed-4b69-8a79-503a3beb3213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f544ee-4aa5-4c9d-b116-aaed64b43106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f544ee-4aa5-4c9d-b116-aaed64b43106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-95172002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ac3ef6-0496-435f-9117-f26e31886f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9d831e1030417c8c110f406bdd438d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:30Z,use_quota=True,user_id='d4e83c448b684e6fb51b10d149ca0ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06c52e8-a8cc-4446-bda5-2ca99d9169cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06c52e8-a8cc-4446-bda5-2ca99d9169cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb123d7-9cf3-468e-a582-64d58ddeeeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb123d7-9cf3-468e-a582-64d58ddeeeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ac3ef6-0496-435f-9117-f26e31886f86', 'volume_name': 'volume-29ac3ef6-0496-435f-9117-f26e31886f86', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064ec51c-0866-490f-923b-d9a0eaf6bb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064ec51c-0866-490f-923b-d9a0eaf6bb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a482fd1-fa0e-4676-99bc-0489d1b5cf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:30 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Volume 29ac3ef6-0496-435f-9117-f26e31886f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ac3ef6-0496-435f-9117-f26e31886f86', 'volume_size': 1} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-95172002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ac3ef6-0496-435f-9117-f26e31886f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9d831e1030417c8c110f406bdd438d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:30Z,use_quota=True,user_id='d4e83c448b684e6fb51b10d149ca0ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Creating volume 29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:30 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:30 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 1073741824 Feb 26 03:21:30 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:30 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 1073741824" returned: 0 in 0.501s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:30 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 Feb 26 03:21:30 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:31 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:21:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a482fd1-fa0e-4676-99bc-0489d1b5cf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ac3ef6-0496-435f-9117-f26e31886f86', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8d1db5-8749-48dd-82bd-3192936c63df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:31 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Volume volume-29ac3ef6-0496-435f-9117-f26e31886f86 (29ac3ef6-0496-435f-9117-f26e31886f86): created successfully Feb 26 03:21:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8d1db5-8749-48dd-82bd-3192936c63df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Flow 'volume_create_manager' (a3a031b9-01ed-4b69-8a79-503a3beb3213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:31 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b8018a33-b52e-49ef-9e90-98d98ba97a5d tempest-VolumeDependencyTests-9535143 None] Created volume successfully. Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:32 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:32 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Creating offline snapshot 2d8e1fb9-fe36-46f3-87c4-576b54477783 of volume 29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5186da3e-1acd-46ec-9f44-b336d97fc473]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:32 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 Feb 26 03:21:32 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:32 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.413s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:32 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86" returned: 0 in 0.500s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:32 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 1G Feb 26 03:21:32 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:33 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 1G" returned: 0 in 0.455s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ac3ef6-0496-435f-9117-f26e31886f86 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:33 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ac3ef6-0496-435f-9117-f26e31886f86 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 Feb 26 03:21:33 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:33 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ac3ef6-0496-435f-9117-f26e31886f86 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783" returned: 0 in 0.441s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:33 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 is being set with open permissions: ugo+rw Feb 26 03:21:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:33 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 Feb 26 03:21:33 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:34 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783" returned: 0 in 0.406s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:34 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.info Feb 26 03:21:34 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:34 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.info" returned: 0 in 0.384s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:34 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.info is being set with open permissions: ugo+rw Feb 26 03:21:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:34 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.info Feb 26 03:21:34 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:34 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.info" returned: 0 in 0.414s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.655s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:34 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-352ba310-31f3-4c27-b88e-ad9de15c8c14 tempest-VolumeDependencyTests-9535143 None] Create snapshot completed successfully Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Flow 'volume_create_manager' (e1f2f35b-9ff1-4bc8-8546-a0e818caa314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89575c16-415a-48f4-a850-d9d674628581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89575c16-415a-48f4-a850-d9d674628581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-315244424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66903746-c13a-41ac-8294-c98c4073f0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9d831e1030417c8c110f406bdd438d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2d8e1fb9-fe36-46f3-87c4-576b54477783,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:36Z,use_quota=True,user_id='d4e83c448b684e6fb51b10d149ca0ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2b4127-397f-4a2b-a64d-199b8f493fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2b4127-397f-4a2b-a64d-199b8f493fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18d69d3-fd89-4b50-ae4f-2d681739fef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18d69d3-fd89-4b50-ae4f-2d681739fef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66903746-c13a-41ac-8294-c98c4073f0c4', 'volume_name': 'volume-66903746-c13a-41ac-8294-c98c4073f0c4', 'volume_size': 1, 'snapshot_id': '2d8e1fb9-fe36-46f3-87c4-576b54477783'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a26ea99-0347-46ed-a34f-cac8338a1f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a26ea99-0347-46ed-a34f-cac8338a1f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbeaab5-89dd-4d55-957a-c9b73248e7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:35 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Volume 66903746-c13a-41ac-8294-c98c4073f0c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66903746-c13a-41ac-8294-c98c4073f0c4', 'volume_size': 1, 'snapshot_id': '2d8e1fb9-fe36-46f3-87c4-576b54477783'} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-quobyte-2d8e1fb9-fe36-46f3-87c4-576b54477783-66903746-c13a-41ac-8294-c98c4073f0c4" by "_create_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-2d8e1fb9-fe36-46f3-87c4-576b54477783-66903746-c13a-41ac-8294-c98c4073f0c4" acquired by "_create_volume_from_snapshot" :: waited 0.005s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Creating volume 66903746-c13a-41ac-8294-c98c4073f0c4 from snapshot 2d8e1fb9-fe36-46f3-87c4-576b54477783 {{(pid=83121) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-quobyte-66903746-c13a-41ac-8294-c98c4073f0c4" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-66903746-c13a-41ac-8294-c98c4073f0c4" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] snapshot: 2d8e1fb9-fe36-46f3-87c4-576b54477783, volume: 66903746-c13a-41ac-8294-c98c4073f0c4, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d463a5-2df3-4c48-82a4-ac5664b9ff8d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:35 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 Feb 26 03:21:35 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:36 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783" returned: 0 in 0.491s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29ac3ef6-0496-435f-9117-f26e31886f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:21:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:21:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:21:36 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5926c614-a0ce-4e14-9300-35cfd83d0791]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:36 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 Feb 26 03:21:36 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:36 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:36 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:21:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:36 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 Feb 26 03:21:36 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:38 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4" returned: 0 in 1.930s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:38 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed4e451-ede2-485a-9ba5-ffbef812e645]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:38 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 Feb 26 03:21:38 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:39 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86" returned: 0 in 0.559s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:21:39 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Converted 1024.00 MB image at 530.28 MB/s Feb 26 03:21:39 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 is being set with open permissions: ugo+rw Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:39 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 Feb 26 03:21:39 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:39 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-66903746-c13a-41ac-8294-c98c4073f0c4" released by "_copy_volume_from_snapshot" :: held 3.866s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-2d8e1fb9-fe36-46f3-87c4-576b54477783-66903746-c13a-41ac-8294-c98c4073f0c4" released by "_create_volume_from_snapshot" :: held 3.881s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.887s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbeaab5-89dd-4d55-957a-c9b73248e7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66903746-c13a-41ac-8294-c98c4073f0c4', 'volume_size': 1, 'snapshot_id': '2d8e1fb9-fe36-46f3-87c4-576b54477783'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab819d1-30a8-4cf3-8dcd-1700325e9ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:39 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Volume volume-66903746-c13a-41ac-8294-c98c4073f0c4 (66903746-c13a-41ac-8294-c98c4073f0c4): created successfully Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab819d1-30a8-4cf3-8dcd-1700325e9ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Flow 'volume_create_manager' (e1f2f35b-9ff1-4bc8-8546-a0e818caa314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:39 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6e796cf8-51db-4de2-bcf1-d95d578c5708 tempest-VolumeDependencyTests-9535143 None] Created volume successfully. Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-2d8e1fb9-fe36-46f3-87c4-576b54477783-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-2d8e1fb9-fe36-46f3-87c4-576b54477783-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-quobyte-29ac3ef6-0496-435f-9117-f26e31886f86" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-29ac3ef6-0496-435f-9117-f26e31886f86" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-quobyte-2d8e1fb9-fe36-46f3-87c4-576b54477783" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-2d8e1fb9-fe36-46f3-87c4-576b54477783" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Deleting offline snapshot 2d8e1fb9-fe36-46f3-87c4-576b54477783 of volume 29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] snapshot_file for this snap is: volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6006c808-9c63-43d1-9a25-f4859094cb45]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:40 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 Feb 26 03:21:40 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:40 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783" returned: 0 in 0.461s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29ac3ef6-0496-435f-9117-f26e31886f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b026f20d-1fef-401a-83c0-c384696c9b38]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:40 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 Feb 26 03:21:40 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:41 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86" returned: 0 in 0.485s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:41 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 Feb 26 03:21:41 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:41 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783" returned: 0 in 0.439s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:41 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783 Feb 26 03:21:41 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:41 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86.2d8e1fb9-fe36-46f3-87c4-576b54477783" returned: 0 in 0.385s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-2d8e1fb9-fe36-46f3-87c4-576b54477783" released by "_delete_snapshot" :: held 1.816s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-29ac3ef6-0496-435f-9117-f26e31886f86" released by "delete_snapshot" :: held 1.828s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:41 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Created reservations ['67663698-80d9-48e0-95ab-fe3c1024b919', 'eefb4327-550e-4461-bca2-4d8e6b42ff4c', '0c3fd19f-3f1d-4899-a1d2-8fced639fc4d', '2a4e4f26-3ac4-4be4-8c84-946193af859a'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:41 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Delete snapshot completed successfully. Feb 26 03:21:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-637fc2c2-6655-416a-8646-17b7cf6ede73 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-2d8e1fb9-fe36-46f3-87c4-576b54477783-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-29ac3ef6-0496-435f-9117-f26e31886f86-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-29ac3ef6-0496-435f-9117-f26e31886f86-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-quobyte-29ac3ef6-0496-435f-9117-f26e31886f86" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-29ac3ef6-0496-435f-9117-f26e31886f86" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:42 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4add5ca-6461-4283-91df-e5c5863b6d30]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:42 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 Feb 26 03:21:42 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:42 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:42 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86 Feb 26 03:21:42 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:43 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-29ac3ef6-0496-435f-9117-f26e31886f86" returned: 0 in 0.378s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-29ac3ef6-0496-435f-9117-f26e31886f86" released by "delete_volume" :: held 0.853s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Created reservations ['3a0967b7-e85e-4287-87fc-d0d57cd02364', 'bfcdfe5c-c6d8-4b1e-880e-7e3180698bd9', 'bc6b0f0a-9d65-4542-80e0-71fc52fa736a', '4dbdec38-7d08-445c-8102-2f0c3d08e7bc'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:43 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:43 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Flow 'volume_create_manager' (fe847662-5e0e-48bd-a4ba-bae25b54b044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1d3d76-900a-4ac7-ba1e-0500ab21554a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1d3d76-900a-4ac7-ba1e-0500ab21554a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1428101715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d2c357-7995-43dc-8781-fa5919be1e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9d831e1030417c8c110f406bdd438d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:43Z,use_quota=True,user_id='d4e83c448b684e6fb51b10d149ca0ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74681961-6e27-4f30-90fe-7f21370cbcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74681961-6e27-4f30-90fe-7f21370cbcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6849be-6765-4907-84c3-811370e0e86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6849be-6765-4907-84c3-811370e0e86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d2c357-7995-43dc-8781-fa5919be1e81', 'volume_name': 'volume-52d2c357-7995-43dc-8781-fa5919be1e81', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f426097-d940-40d7-96d9-b9b8a2c7ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f426097-d940-40d7-96d9-b9b8a2c7ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf508002-ec98-40c9-b0f2-0965db2efe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:43 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Volume 52d2c357-7995-43dc-8781-fa5919be1e81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d2c357-7995-43dc-8781-fa5919be1e81', 'volume_size': 1} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1428101715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d2c357-7995-43dc-8781-fa5919be1e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9d831e1030417c8c110f406bdd438d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:43Z,use_quota=True,user_id='d4e83c448b684e6fb51b10d149ca0ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Creating volume 52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:43 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:43 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.455s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:43 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Deleted volume successfully. Feb 26 03:21:43 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 1073741824 Feb 26 03:21:43 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6f09e56c-ec6e-4e3f-b9d9-c44ae83f01f4 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-29ac3ef6-0496-435f-9117-f26e31886f86-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:43 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 1073741824" returned: 0 in 0.438s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:44 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 Feb 26 03:21:44 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:44 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf508002-ec98-40c9-b0f2-0965db2efe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d2c357-7995-43dc-8781-fa5919be1e81', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c82e767-63bd-4a47-9945-90cfdfa9d236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:44 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Volume volume-52d2c357-7995-43dc-8781-fa5919be1e81 (52d2c357-7995-43dc-8781-fa5919be1e81): created successfully Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c82e767-63bd-4a47-9945-90cfdfa9d236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Flow 'volume_create_manager' (fe847662-5e0e-48bd-a4ba-bae25b54b044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:44 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-cd82ce01-3672-4145-925d-0bfc8de8241b tempest-VolumeDependencyTests-9535143 None] Created volume successfully. Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Flow 'volume_create_manager' (9372fcca-bf15-4da6-906c-b9744bc093a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca059bf-e0df-4595-bdea-c8de168524f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca059bf-e0df-4595-bdea-c8de168524f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1543886939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bb3599-f5f2-429f-ae18-ccad202f0951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9d831e1030417c8c110f406bdd438d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=52d2c357-7995-43dc-8781-fa5919be1e81,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:45Z,use_quota=True,user_id='d4e83c448b684e6fb51b10d149ca0ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672fe6fc-49b6-45b7-8117-756a84d90c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672fe6fc-49b6-45b7-8117-756a84d90c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa80347-e4fc-448a-aa2e-5f8ccabbb16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa80347-e4fc-448a-aa2e-5f8ccabbb16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '32bb3599-f5f2-429f-ae18-ccad202f0951', 'volume_name': 'volume-32bb3599-f5f2-429f-ae18-ccad202f0951', 'volume_size': 1, 'source_volid': '52d2c357-7995-43dc-8781-fa5919be1e81', 'source_volstatus': 'available'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeac976e-6769-454f-be6a-8a50a1f6b6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeac976e-6769-454f-be6a-8a50a1f6b6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaad3e9f-14ba-4e6c-97ac-0a8127366a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:44 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Volume 32bb3599-f5f2-429f-ae18-ccad202f0951: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-32bb3599-f5f2-429f-ae18-ccad202f0951', 'volume_size': 1, 'source_volid': '52d2c357-7995-43dc-8781-fa5919be1e81', 'source_volstatus': 'available'} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:44 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Cloning volume 52d2c357-7995-43dc-8781-fa5919be1e81 to volume 32bb3599-f5f2-429f-ae18-ccad202f0951 Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Creating offline snapshot 6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 of volume 52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f5f55d-b582-4e90-89ea-049da7efda15]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:44 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 Feb 26 03:21:44 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:45 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:45 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 1G Feb 26 03:21:45 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:45 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 1G" returned: 0 in 0.475s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d2c357-7995-43dc-8781-fa5919be1e81 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:45 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d2c357-7995-43dc-8781-fa5919be1e81 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 Feb 26 03:21:45 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:46 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d2c357-7995-43dc-8781-fa5919be1e81 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3" returned: 0 in 0.418s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:46 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 is being set with open permissions: ugo+rw Feb 26 03:21:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:46 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 Feb 26 03:21:46 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:46 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3" returned: 0 in 0.379s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:46 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=114,cinder:SELECT=73,cinder:INSERT=22,cinder:DELETE=7 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:21:46 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=72,cinder:INSERT=24,cinder:UPDATE=83,cinder:DELETE=11 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:21:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:46 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.info Feb 26 03:21:46 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:47 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.info" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:47 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.info is being set with open permissions: ugo+rw Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:47 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.info Feb 26 03:21:47 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:47 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.info" returned: 0 in 0.379s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-quobyte-32bb3599-f5f2-429f-ae18-ccad202f0951" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-32bb3599-f5f2-429f-ae18-ccad202f0951" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] snapshot: 6446ab84-e7b8-4bc6-a96b-c32b1d4857b3, volume: 32bb3599-f5f2-429f-ae18-ccad202f0951, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[529fddac-3fa7-4549-a1e7-5bdb96fd5e35]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:47 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 Feb 26 03:21:47 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:47 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3" returned: 0 in 0.480s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52d2c357-7995-43dc-8781-fa5919be1e81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d35f72-333a-4583-abf8-1f6d67b58880]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:47 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 Feb 26 03:21:47 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:48 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81" returned: 0 in 0.466s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:48 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:21:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:48 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 Feb 26 03:21:48 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:50 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951" returned: 0 in 1.952s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:50 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[155f2888-7902-41c2-aa2f-d70d826055eb]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:50 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 Feb 26 03:21:50 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:50 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81" returned: 0 in 0.563s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:50 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:21:50 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Converted 1024.00 MB image at 524.33 MB/s Feb 26 03:21:50 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 is being set with open permissions: ugo+rw Feb 26 03:21:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:50 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 Feb 26 03:21:50 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:51 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951" returned: 0 in 0.385s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-32bb3599-f5f2-429f-ae18-ccad202f0951" released by "_copy_volume_from_snapshot" :: held 3.885s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-quobyte-6446ab84-e7b8-4bc6-a96b-c32b1d4857b3" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-6446ab84-e7b8-4bc6-a96b-c32b1d4857b3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Deleting offline snapshot 6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 of volume 52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] snapshot_file for this snap is: volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeea22e-3a9e-4728-bd84-c8de06e49e07]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:51 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 Feb 26 03:21:51 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:51 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52d2c357-7995-43dc-8781-fa5919be1e81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[da47c8b5-3ca6-49ac-baa6-af97160c967c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:51 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 Feb 26 03:21:51 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:52 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81" returned: 0 in 0.470s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:52 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 Feb 26 03:21:52 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:52 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:52 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3 Feb 26 03:21:52 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:53 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81.6446ab84-e7b8-4bc6-a96b-c32b1d4857b3" returned: 0 in 0.405s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-6446ab84-e7b8-4bc6-a96b-c32b1d4857b3" released by "_delete_snapshot" :: held 1.810s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.313s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaad3e9f-14ba-4e6c-97ac-0a8127366a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32bb3599-f5f2-429f-ae18-ccad202f0951', 'volume_size': 1, 'source_volid': '52d2c357-7995-43dc-8781-fa5919be1e81', 'source_volstatus': 'available'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ab3c56-ee41-4aae-a941-07ae9cd3bf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:53 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Volume volume-32bb3599-f5f2-429f-ae18-ccad202f0951 (32bb3599-f5f2-429f-ae18-ccad202f0951): created successfully Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ab3c56-ee41-4aae-a941-07ae9cd3bf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Flow 'volume_create_manager' (9372fcca-bf15-4da6-906c-b9744bc093a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:53 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-95af5bcf-ffe9-4d76-9bc8-db9b8668cb6a tempest-VolumeDependencyTests-9535143 None] Created volume successfully. Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-52d2c357-7995-43dc-8781-fa5919be1e81-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Lock "cinder-52d2c357-7995-43dc-8781-fa5919be1e81-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-quobyte-52d2c357-7995-43dc-8781-fa5919be1e81" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-52d2c357-7995-43dc-8781-fa5919be1e81" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff64407a-d4c4-4e60-9587-d2d4a31ba33a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:53 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 Feb 26 03:21:53 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:53 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81" returned: 0 in 0.468s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:53 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81 Feb 26 03:21:53 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:54 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-52d2c357-7995-43dc-8781-fa5919be1e81" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-52d2c357-7995-43dc-8781-fa5919be1e81" released by "delete_volume" :: held 0.893s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Created reservations ['127bf500-d640-4481-af7d-c2fba870f4a1', 'f84a09cc-b45c-4dfb-aaa9-48cafa1e0274', '872a403f-b254-442d-8a9e-eb2f688202f2', '2fa9c03f-a8b5-453b-a575-30e5bc93a6a4'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:54 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:54 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-32bb3599-f5f2-429f-ae18-ccad202f0951-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-32bb3599-f5f2-429f-ae18-ccad202f0951-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-quobyte-32bb3599-f5f2-429f-ae18-ccad202f0951" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-32bb3599-f5f2-429f-ae18-ccad202f0951" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a74e31-7195-48e5-9f03-01d42fa261a1]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:54 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 Feb 26 03:21:54 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:54 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Deleted volume successfully. Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-32288e4e-cca7-4de8-8dfb-c7f373ec23fb tempest-VolumeDependencyTests-9535143 None] Lock "cinder-52d2c357-7995-43dc-8781-fa5919be1e81-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:54 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951" returned: 0 in 0.454s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:54 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951 Feb 26 03:21:54 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:55 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-32bb3599-f5f2-429f-ae18-ccad202f0951" returned: 0 in 0.401s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-32bb3599-f5f2-429f-ae18-ccad202f0951" released by "delete_volume" :: held 0.879s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Created reservations ['92cb5b11-3a14-4cbb-b9bc-39a7fa9b6379', '09af6b88-2265-46a3-ae97-27360a0f4df5', 'cd3ca8e6-41e4-447e-8d15-829c8e6dc125', 'd0ef73f4-3adf-4858-9795-8865f8d8ba58'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:55 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:55 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-66903746-c13a-41ac-8294-c98c4073f0c4-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Lock "cinder-66903746-c13a-41ac-8294-c98c4073f0c4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Acquiring lock "cinder-quobyte-66903746-c13a-41ac-8294-c98c4073f0c4" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-66903746-c13a-41ac-8294-c98c4073f0c4" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a547a1-a92f-4fb7-92f0-79863a7b33c2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:55 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 Feb 26 03:21:55 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:55 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.414s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:55 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Deleted volume successfully. Feb 26 03:21:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4f40ddd2-c8af-4002-9d2d-b154d115bc84 tempest-VolumeDependencyTests-9535143 None] Lock "cinder-32bb3599-f5f2-429f-ae18-ccad202f0951-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:56 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4" returned: 0 in 0.462s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:56 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4 Feb 26 03:21:56 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:56 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-66903746-c13a-41ac-8294-c98c4073f0c4" returned: 0 in 0.389s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Lock "cinder-quobyte-66903746-c13a-41ac-8294-c98c4073f0c4" released by "delete_volume" :: held 0.882s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Created reservations ['814cbab9-d1a3-439b-aaa6-97b9ebf5f7f0', 'bcc10831-117b-48de-a155-9109a68ce660', '2ca19ff2-181f-4234-9c98-7c6d94686878', '0a004575-1473-4978-ba2e-350267b843a1'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:56 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:21:56 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:56 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.445s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:21:56 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Deleted volume successfully. Feb 26 03:21:56 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14039c9e-43f3-4258-be89-a25aeab3f01c tempest-VolumeDependencyTests-9535143 None] Lock "cinder-66903746-c13a-41ac-8294-c98c4073f0c4-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Flow 'volume_create_manager' (f8e9f5c8-d5ea-4047-933f-6c219337d1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404decdb-4266-41d2-a1c2-7273bf6912da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404decdb-4266-41d2-a1c2-7273bf6912da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e328da9f-34f7-422b-ab77-c54eb4c68030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c768d53e3e49bc96f3f60ef4f271b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:58Z,use_quota=True,user_id='a24902da4bef4bb9ab9643a1613370dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6787ffb-8222-44f6-a397-ce29fff35dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6787ffb-8222-44f6-a397-ce29fff35dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1feb3a9-2517-4fc1-9492-281d5f8c13c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1feb3a9-2517-4fc1-9492-281d5f8c13c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e328da9f-34f7-422b-ab77-c54eb4c68030', 'volume_name': 'volume-e328da9f-34f7-422b-ab77-c54eb4c68030', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4067f269-3784-4955-9911-7c6d000b0791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4067f269-3784-4955-9911-7c6d000b0791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bada3a7b-6eae-49d7-8c4c-3577de6be17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:58 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Volume e328da9f-34f7-422b-ab77-c54eb4c68030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e328da9f-34f7-422b-ab77-c54eb4c68030', 'volume_size': 1} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e328da9f-34f7-422b-ab77-c54eb4c68030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c768d53e3e49bc96f3f60ef4f271b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:21:58Z,use_quota=True,user_id='a24902da4bef4bb9ab9643a1613370dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Creating volume e328da9f-34f7-422b-ab77-c54eb4c68030 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:58 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:58 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030 1073741824 Feb 26 03:21:58 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:58 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030 1073741824" returned: 0 in 0.454s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:58 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030 Feb 26 03:21:58 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:21:59 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bada3a7b-6eae-49d7-8c4c-3577de6be17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e328da9f-34f7-422b-ab77-c54eb4c68030', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1724a6-91ba-49f8-a423-44c437470540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:59 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Volume volume-e328da9f-34f7-422b-ab77-c54eb4c68030 (e328da9f-34f7-422b-ab77-c54eb4c68030): created successfully Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1724a6-91ba-49f8-a423-44c437470540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Flow 'volume_create_manager' (f8e9f5c8-d5ea-4047-933f-6c219337d1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:59 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-c4e22a2d-0d16-46b2-a4be-e7cfd488d651 tempest-CinderUnicodeTest-1907770997 None] Created volume successfully. Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Flow 'volume_create_manager' (0c70cf8a-bcae-4fea-923b-c37b6b57a56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011ab5fa-8354-4da7-a550-46693a806893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011ab5fa-8354-4da7-a550-46693a806893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2003346358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cee4a44-47a8-4372-9775-62b6845e3ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c768d53e3e49bc96f3f60ef4f271b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:22:00Z,use_quota=True,user_id='a24902da4bef4bb9ab9643a1613370dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f48f63c-e537-493d-9f2f-a069dad912a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f48f63c-e537-493d-9f2f-a069dad912a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dda4227-65e7-41ec-8abc-ce127d19228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dda4227-65e7-41ec-8abc-ce127d19228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cee4a44-47a8-4372-9775-62b6845e3ae1', 'volume_name': 'volume-0cee4a44-47a8-4372-9775-62b6845e3ae1', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2223fc08-212a-4755-b19b-542bdcd65d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2223fc08-212a-4755-b19b-542bdcd65d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ddaf3c-9f12-4aa1-8c94-2be4e2fcbf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:21:59 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Volume 0cee4a44-47a8-4372-9775-62b6845e3ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cee4a44-47a8-4372-9775-62b6845e3ae1', 'volume_size': 1} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:21:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2003346358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cee4a44-47a8-4372-9775-62b6845e3ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c768d53e3e49bc96f3f60ef4f271b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:22:00Z,use_quota=True,user_id='a24902da4bef4bb9ab9643a1613370dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Creating volume 0cee4a44-47a8-4372-9775-62b6845e3ae1 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:21:59 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:21:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:21:59 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 1073741824 Feb 26 03:21:59 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:00 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 1073741824" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:00 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 Feb 26 03:22:00 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:00 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1" returned: 0 in 0.374s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ddaf3c-9f12-4aa1-8c94-2be4e2fcbf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cee4a44-47a8-4372-9775-62b6845e3ae1', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991fc4d4-ef44-41ea-b9c3-52e601f51ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:22:00 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Volume volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 (0cee4a44-47a8-4372-9775-62b6845e3ae1): created successfully Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991fc4d4-ef44-41ea-b9c3-52e601f51ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Flow 'volume_create_manager' (0c70cf8a-bcae-4fea-923b-c37b6b57a56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:22:00 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-461e8bc0-fa30-450b-8992-ed3a269826f9 tempest-CinderUnicodeTest-1907770997 None] Created volume successfully. Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Creating offline snapshot e94479b8-6491-423c-8a90-9b21bdb48abc of volume 0cee4a44-47a8-4372-9775-62b6845e3ae1 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f64300-d8c7-48a7-aefb-9090961ef308]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:22:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:00 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 Feb 26 03:22:00 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:01 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:01 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc 1G Feb 26 03:22:01 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:01 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc 1G" returned: 0 in 0.426s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:01 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc Feb 26 03:22:01 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:02 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc" returned: 0 in 0.411s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:02 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc is being set with open permissions: ugo+rw Feb 26 03:22:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:02 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc Feb 26 03:22:02 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:02 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc" returned: 0 in 0.379s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:02 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.info Feb 26 03:22:02 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:02 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.info" returned: 0 in 0.385s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:02 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.info is being set with open permissions: ugo+rw Feb 26 03:22:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:02 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.info Feb 26 03:22:02 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:03 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.info" returned: 0 in 0.392s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:22:03 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f666d50f-fd9a-4099-8dc2-0be623f2017d tempest-CinderUnicodeTest-1907770997 None] Create snapshot completed successfully Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "cinder-e94479b8-6491-423c-8a90-9b21bdb48abc-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-e94479b8-6491-423c-8a90-9b21bdb48abc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "cinder-quobyte-0cee4a44-47a8-4372-9775-62b6845e3ae1" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-quobyte-0cee4a44-47a8-4372-9775-62b6845e3ae1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "cinder-quobyte-e94479b8-6491-423c-8a90-9b21bdb48abc" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-quobyte-e94479b8-6491-423c-8a90-9b21bdb48abc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Deleting offline snapshot e94479b8-6491-423c-8a90-9b21bdb48abc of volume 0cee4a44-47a8-4372-9775-62b6845e3ae1 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] snapshot_file for this snap is: volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d15f5ae-8db2-4cc3-a6a7-858c6305a3a2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:22:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:04 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc Feb 26 03:22:04 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:04 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc" returned: 0 in 0.486s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cee4a44-47a8-4372-9775-62b6845e3ae1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:22:04 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c6c6c6-785b-48b6-9a00-a1e9fcc8f55e]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:22:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:04 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 Feb 26 03:22:04 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:04 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1" returned: 0 in 0.444s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:04 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc Feb 26 03:22:04 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:05 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc" returned: 0 in 0.415s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:05 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc Feb 26 03:22:05 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:05 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1.e94479b8-6491-423c-8a90-9b21bdb48abc" returned: 0 in 0.402s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:05 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-quobyte-e94479b8-6491-423c-8a90-9b21bdb48abc" released by "_delete_snapshot" :: held 1.796s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:22:05 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-quobyte-0cee4a44-47a8-4372-9775-62b6845e3ae1" released by "delete_snapshot" :: held 1.807s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:22:05 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Created reservations ['91267353-7c2c-4380-aba4-6f14d81dbaaa', 'a88ef12d-076a-49f0-9012-7a537c14169f', 'bbfb904e-6a9b-4c41-b0de-fb761dc139d2', 'ee5bbb8e-3dfb-4292-adfa-488ecadfee7b'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:22:05 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Delete snapshot completed successfully. Feb 26 03:22:05 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cbb75623-d936-4843-a0d9-eac80d2e031c tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-e94479b8-6491-423c-8a90-9b21bdb48abc-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "cinder-0cee4a44-47a8-4372-9775-62b6845e3ae1-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-0cee4a44-47a8-4372-9775-62b6845e3ae1-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "cinder-quobyte-0cee4a44-47a8-4372-9775-62b6845e3ae1" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-quobyte-0cee4a44-47a8-4372-9775-62b6845e3ae1" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee5fbcd-9825-428e-ba0a-840cfcf52e0e]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:06 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 Feb 26 03:22:06 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:06 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:06 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1 Feb 26 03:22:06 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:06 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-0cee4a44-47a8-4372-9775-62b6845e3ae1" returned: 0 in 0.398s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-quobyte-0cee4a44-47a8-4372-9775-62b6845e3ae1" released by "delete_volume" :: held 0.873s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:22:06 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Created reservations ['802c9c5e-a1fe-41db-84e7-4c15d4b5fddd', 'be6f0198-8df3-4ece-a801-f1458404aeb8', '728008f9-8ccb-4d8a-b78d-5232cda20a93', '45d81d6c-7bb4-4e3c-8784-f3f7cbefe7b0'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:07 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:22:07 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "cinder-e328da9f-34f7-422b-ab77-c54eb4c68030-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-e328da9f-34f7-422b-ab77-c54eb4c68030-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "cinder-quobyte-e328da9f-34f7-422b-ab77-c54eb4c68030" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-quobyte-e328da9f-34f7-422b-ab77-c54eb4c68030" acquired by "delete_volume" :: waited 0.014s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eef53c8-4dea-4b63-9170-82863b6febea]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:07 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030 Feb 26 03:22:07 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:07 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.408s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:22:07 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Deleted volume successfully. Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-f4b26925-3534-4e20-b04b-47aeb629bda1 tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-0cee4a44-47a8-4372-9775-62b6845e3ae1-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:22:07 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030" returned: 0 in 0.457s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:07 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030 Feb 26 03:22:07 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:08 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e328da9f-34f7-422b-ab77-c54eb4c68030" returned: 0 in 0.427s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-quobyte-e328da9f-34f7-422b-ab77-c54eb4c68030" released by "delete_volume" :: held 0.908s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Created reservations ['fea5fd23-e25f-4399-8127-eaf78d9ab179', '713bb258-6a18-4d66-8fb4-9b872e0c8f78', '6a9fd2a7-7db8-4f08-94a8-6c90a54df318', '8bc35dc1-44a0-44a7-ab49-e111d4989342'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:08 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:22:08 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:08 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.486s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:22:08 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Deleted volume successfully. Feb 26 03:22:08 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-de456b5a-8cf3-4f17-b1ce-188875386822 tempest-CinderUnicodeTest-1907770997 None] Lock "cinder-e328da9f-34f7-422b-ab77-c54eb4c68030-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:22:18 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=37,cinder:INSERT=15,cinder:UPDATE=51,cinder:DELETE=6 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:22:18 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=62,cinder:SELECT=42,cinder:INSERT=14,cinder:DELETE=3 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:22:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:22:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:22:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:22:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:22:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:22:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:22:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:22:32 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:22:32 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:22:32 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Feb 26 03:22:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.370s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:22:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Flow 'volume_create_manager' (1178272f-38e8-4cfb-a97f-00c37831ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6673eae-8b1b-4056-baa2-62a6d2c2c9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6673eae-8b1b-4056-baa2-62a6d2c2c9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1569251282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694870ce-7613-4690-bc6d-0c9334d89eb3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89e006af7d8d4af182b24f5bf5ba1b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:02Z,use_quota=True,user_id='0bad158310304fdb8640994066e4839e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2e8734-5e0b-421e-9858-4cdcbb4c4837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2e8734-5e0b-421e-9858-4cdcbb4c4837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdf2496-07bf-4933-92da-253c11da09de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdf2496-07bf-4933-92da-253c11da09de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694870ce-7613-4690-bc6d-0c9334d89eb3', 'volume_name': 'volume-694870ce-7613-4690-bc6d-0c9334d89eb3', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cec821-aee4-414a-b3ca-d312ff720587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cec821-aee4-414a-b3ca-d312ff720587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac0f26f-34c7-4a2c-b24a-cafbcab3e138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:01 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Volume 694870ce-7613-4690-bc6d-0c9334d89eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694870ce-7613-4690-bc6d-0c9334d89eb3', 'volume_size': 1} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1569251282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694870ce-7613-4690-bc6d-0c9334d89eb3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89e006af7d8d4af182b24f5bf5ba1b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:02Z,use_quota=True,user_id='0bad158310304fdb8640994066e4839e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Creating volume 694870ce-7613-4690-bc6d-0c9334d89eb3 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:23:01 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:23:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:01 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3 1073741824 Feb 26 03:23:01 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:02 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3 1073741824" returned: 0 in 0.438s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:02 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3 Feb 26 03:23:02 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:02 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac0f26f-34c7-4a2c-b24a-cafbcab3e138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694870ce-7613-4690-bc6d-0c9334d89eb3', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac9cfe0-36bc-477e-8a6d-38175e85e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:02 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Volume volume-694870ce-7613-4690-bc6d-0c9334d89eb3 (694870ce-7613-4690-bc6d-0c9334d89eb3): created successfully Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac9cfe0-36bc-477e-8a6d-38175e85e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Flow 'volume_create_manager' (1178272f-38e8-4cfb-a97f-00c37831ef25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:02 devstack cinder-volume[83121]: INFO cinder.volume.manager [req-a5d72a16-1146-4d79-beee-39c181aaf4a8 req-bf596a25-0a08-4f72-8b54-8e39a44f4c4f tempest-VolumesGetTestJSON-419079329 None] Created volume successfully. Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Acquiring lock "cinder-694870ce-7613-4690-bc6d-0c9334d89eb3-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Lock "cinder-694870ce-7613-4690-bc6d-0c9334d89eb3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Acquiring lock "cinder-quobyte-694870ce-7613-4690-bc6d-0c9334d89eb3" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Lock "cinder-quobyte-694870ce-7613-4690-bc6d-0c9334d89eb3" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97c057f-91dd-4d7a-94ed-44455a558a2d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:23:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:02 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3 Feb 26 03:23:02 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:03 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3" returned: 0 in 0.440s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:03 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3 Feb 26 03:23:03 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:03 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-694870ce-7613-4690-bc6d-0c9334d89eb3" returned: 0 in 0.378s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Lock "cinder-quobyte-694870ce-7613-4690-bc6d-0c9334d89eb3" released by "delete_volume" :: held 0.838s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG cinder.quota [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Created reservations ['6e9dd782-f191-42c6-b1a5-cdb687609045', '16877c26-5c13-4fbb-9297-b53a65b0570d', '4a54aa24-fcdb-48be-b661-0212a61707d1', '71bd2acd-6f6e-44d3-8e1a-8fa5335a9dc0'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:03 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:23:03 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:04 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.427s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:04 devstack cinder-volume[83121]: DEBUG cinder.manager [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:23:04 devstack cinder-volume[83121]: INFO cinder.volume.manager [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Deleted volume successfully. Feb 26 03:23:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [req-22ee0701-8c0c-40ff-8650-e2b4943f7a5d req-a9f563e3-a6ef-405e-a5be-6c0018b22341 tempest-VolumesGetTestJSON-419079329 None] Lock "cinder-694870ce-7613-4690-bc6d-0c9334d89eb3-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:23:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-84b4c8f1-0bfd-47d7-aafc-2e49074b53ed tempest-BackendsCapabilitiesAdminTestsJSON-1720558409 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580528259277, 'free_capacity_gb': 1775.7580528259277, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83121) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 26 03:23:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-77334c02-90eb-456c-bb56-fcf99455ecf1 tempest-BackendsCapabilitiesAdminTestsJSON-1720558409 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580528259277, 'free_capacity_gb': 1775.7580528259277, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83121) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 26 03:23:12 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0465e6ff-4575-45a9-9ec6-8f53fd42352d tempest-GroupSnapshotsV319Test-1682809706 None] Group tempest-GroupSnapshotsV319Test-Group-379696500: creating Feb 26 03:23:12 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0465e6ff-4575-45a9-9ec6-8f53fd42352d tempest-GroupSnapshotsV319Test-1682809706 None] Group tempest-GroupSnapshotsV319Test-Group-379696500: created successfully Feb 26 03:23:12 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0465e6ff-4575-45a9-9ec6-8f53fd42352d tempest-GroupSnapshotsV319Test-1682809706 None] Create group completed successfully. Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Flow 'volume_create_manager' (96c8106e-7173-4381-ad2b-932e3d904802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed686f2-7c1d-479c-9dfa-42e1dea299a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed686f2-7c1d-479c-9dfa-42e1dea299a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2117527709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=219ed805-62ca-4d20-ba47-8f07b8210d3b,host='devstack@QuobyteHD#QuobyteHD',id=cc0c8958-f463-4b19-a818-67b942d41a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d9fdc650d543bd8199a499e253143b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:14Z,use_quota=True,user_id='ba08340437824ed5a999abdd039c01b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddcc2824-210a-4ad7-a509-d8e13fbbdd58),volume_type_id=ddcc2824-210a-4ad7-a509-d8e13fbbdd58)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0430e9-4139-4f3f-a071-db6b1aebddfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0430e9-4139-4f3f-a071-db6b1aebddfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9a9a4b-93ef-42c1-a41e-7a903fe57c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9a9a4b-93ef-42c1-a41e-7a903fe57c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0c8958-f463-4b19-a818-67b942d41a64', 'volume_name': 'volume-cc0c8958-f463-4b19-a818-67b942d41a64', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9bd80e8-0292-4c85-8d20-f5b9ecc50398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9bd80e8-0292-4c85-8d20-f5b9ecc50398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4bcf68-5e17-41ff-83ee-bff3957b766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:13 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Volume cc0c8958-f463-4b19-a818-67b942d41a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0c8958-f463-4b19-a818-67b942d41a64', 'volume_size': 1} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=219ed805-62ca-4d20-ba47-8f07b8210d3b,created_at=2026-02-26T02:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2117527709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=219ed805-62ca-4d20-ba47-8f07b8210d3b,host='devstack@QuobyteHD#QuobyteHD',id=cc0c8958-f463-4b19-a818-67b942d41a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d9fdc650d543bd8199a499e253143b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:14Z,use_quota=True,user_id='ba08340437824ed5a999abdd039c01b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddcc2824-210a-4ad7-a509-d8e13fbbdd58),volume_type_id=ddcc2824-210a-4ad7-a509-d8e13fbbdd58)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Creating volume cc0c8958-f463-4b19-a818-67b942d41a64 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:23:13 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:23:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:13 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 1073741824 Feb 26 03:23:13 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:14 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 1073741824" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:14 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 Feb 26 03:23:14 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:14 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64" returned: 0 in 0.377s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4bcf68-5e17-41ff-83ee-bff3957b766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0c8958-f463-4b19-a818-67b942d41a64', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbe0879-3940-4a34-afe5-bc102192e680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:14 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Volume volume-cc0c8958-f463-4b19-a818-67b942d41a64 (cc0c8958-f463-4b19-a818-67b942d41a64): created successfully Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbe0879-3940-4a34-afe5-bc102192e680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Flow 'volume_create_manager' (96c8106e-7173-4381-ad2b-932e3d904802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:14 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-d3c07fae-8edb-463e-b6b0-79eb55d39a7f tempest-GroupSnapshotsV319Test-1682809706 None] Created volume successfully. Feb 26 03:23:14 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] GroupSnapshot 40629e64-b9b3-4f31-9301-932d23df64fb: creating. Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Group snapshot 40629e64-b9b3-4f31-9301-932d23df64fb: creating. {{(pid=83121) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Creating offline snapshot 5988c51f-6d03-4fb4-aa98-8367b122ec92 of volume cc0c8958-f463-4b19-a818-67b942d41a64 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dc1934-f1f4-4934-b0b1-1de7f7d88569]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:23:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:14 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 Feb 26 03:23:14 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:15 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64" returned: 0 in 0.453s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:15 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 1G Feb 26 03:23:15 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:15 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 1G" returned: 0 in 0.458s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0c8958-f463-4b19-a818-67b942d41a64 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:15 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0c8958-f463-4b19-a818-67b942d41a64 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 Feb 26 03:23:15 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:16 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0c8958-f463-4b19-a818-67b942d41a64 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92" returned: 0 in 0.403s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:16 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:23:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:16 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 Feb 26 03:23:16 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:16 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92" returned: 0 in 0.377s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:16 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.info Feb 26 03:23:16 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:16 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.info" returned: 0 in 0.385s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:16 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.info is being set with open permissions: ugo+rw: NotImplementedError Feb 26 03:23:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:16 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.info Feb 26 03:23:16 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:17 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.info" returned: 0 in 0.387s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:17 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8df45704-e12a-4e31-bdb0-9899b456b8b3 tempest-GroupSnapshotsV319Test-1682809706 None] group_snapshot 40629e64-b9b3-4f31-9301-932d23df64fb: created successfully Feb 26 03:23:18 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] group_snapshot 40629e64-b9b3-4f31-9301-932d23df64fb: deleting Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] group_snapshot 40629e64-b9b3-4f31-9301-932d23df64fb: deleting {{(pid=83121) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Acquiring lock "cinder-quobyte-cc0c8958-f463-4b19-a818-67b942d41a64" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Lock "cinder-quobyte-cc0c8958-f463-4b19-a818-67b942d41a64" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Acquiring lock "cinder-quobyte-5988c51f-6d03-4fb4-aa98-8367b122ec92" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Lock "cinder-quobyte-5988c51f-6d03-4fb4-aa98-8367b122ec92" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Deleting offline snapshot 5988c51f-6d03-4fb4-aa98-8367b122ec92 of volume cc0c8958-f463-4b19-a818-67b942d41a64 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] snapshot_file for this snap is: volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[531bfd5b-6c8b-40dc-bc97-7ba60640333d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:18 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 Feb 26 03:23:18 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:18 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92" returned: 0 in 0.451s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc0c8958-f463-4b19-a818-67b942d41a64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3ff329-2757-49b0-8f84-db543bb84b03]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:23:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:18 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 Feb 26 03:23:18 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:19 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64" returned: 0 in 0.461s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:19 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 Feb 26 03:23:19 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:19 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92" returned: 0 in 0.423s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:19 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92 Feb 26 03:23:19 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:19 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64.5988c51f-6d03-4fb4-aa98-8367b122ec92" returned: 0 in 0.380s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:20 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Lock "cinder-quobyte-5988c51f-6d03-4fb4-aa98-8367b122ec92" released by "_delete_snapshot" :: held 1.774s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:23:20 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Lock "cinder-quobyte-cc0c8958-f463-4b19-a818-67b942d41a64" released by "delete_snapshot" :: held 1.783s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:23:20 devstack cinder-volume[83121]: WARNING cinder.quota [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-171237202 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-171237202, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:23:20 devstack cinder-volume[83121]: WARNING cinder.quota [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-171237202 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-171237202, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:23:20 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] Created reservations ['11e09838-4e48-4f5c-96f3-9346ac868b70', '8b4decd3-bdc1-4098-964b-1e483dfea302', 'cea55034-466d-41be-b392-d14bd779dff4', '862f8c19-4008-4752-a2c9-51a9007c5278'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:20 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-7789528c-5f13-4ea5-870d-7eac8645d620 tempest-GroupSnapshotsV319Test-1682809706 None] group_snapshot 40629e64-b9b3-4f31-9301-932d23df64fb: deleted successfully Feb 26 03:23:20 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Acquiring lock "cinder-quobyte-cc0c8958-f463-4b19-a818-67b942d41a64" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:23:20 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Lock "cinder-quobyte-cc0c8958-f463-4b19-a818-67b942d41a64" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:23:20 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[133476b8-2604-4d40-b2b1-aa7c04a2f935]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:23:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:20 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 Feb 26 03:23:20 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:20 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64" returned: 0 in 0.440s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:20 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64 Feb 26 03:23:20 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:21 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-cc0c8958-f463-4b19-a818-67b942d41a64" returned: 0 in 0.377s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Lock "cinder-quobyte-cc0c8958-f463-4b19-a818-67b942d41a64" released by "delete_volume" :: held 0.844s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Created reservations ['79ffa8c2-7a3b-47d9-9583-d093edc365cd'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:21 devstack cinder-volume[83121]: WARNING cinder.quota [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-171237202 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-171237202, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Created reservations ['67e5d322-0888-40fe-932a-b3a9717c4bf2', 'b5925ce3-e878-4600-a5a0-3e9835d5eacd', '5fb9bc01-6b54-4780-820c-9d5deafadd23', 'cb0d84d6-5fa5-4015-ad24-fa160578c859'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:21 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:23:21 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:21 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.413s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:21 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:23:21 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b30bd219-2f3c-41ab-9ed9-e30627ac5043 tempest-GroupSnapshotsV319Test-1682809706 None] Delete group completed successfully. Feb 26 03:23:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a63a9755-38f0-438b-9e39-37b60b773d38 tempest-GroupsTest-417772462 None] Group tempest-Group1-219245060: creating Feb 26 03:23:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a63a9755-38f0-438b-9e39-37b60b773d38 tempest-GroupsTest-417772462 None] Group tempest-Group1-219245060: created successfully Feb 26 03:23:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a63a9755-38f0-438b-9e39-37b60b773d38 tempest-GroupsTest-417772462 None] Create group completed successfully. Feb 26 03:23:25 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-1d209c3f-1d14-486d-84ea-84df5c4f25b7 tempest-GroupsTest-417772462 None] Group tempest-Group2-1677887468: creating Feb 26 03:23:25 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-1d209c3f-1d14-486d-84ea-84df5c4f25b7 tempest-GroupsTest-417772462 None] Group tempest-Group2-1677887468: created successfully Feb 26 03:23:25 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-1d209c3f-1d14-486d-84ea-84df5c4f25b7 tempest-GroupsTest-417772462 None] Create group completed successfully. Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Flow 'volume_create_manager' (c2b75e50-88a1-465b-865f-df27866365ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63ddf28-444b-46a4-adfc-0c97e087f493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63ddf28-444b-46a4-adfc-0c97e087f493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1693803575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3142558c-50df-4bfb-9693-1b6474e701bd,host='devstack@QuobyteHD#QuobyteHD',id=7a5e7137-b125-4594-b821-177c39d43312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85273bfd5dd341e4a33d88154aaa79fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:27Z,use_quota=True,user_id='d3b3fe86138c4d71b2f39472ce2c5ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84e31f58-19d4-4f8f-af15-5498b96f82d2),volume_type_id=84e31f58-19d4-4f8f-af15-5498b96f82d2)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff37da4d-12b7-415b-82cf-b422c7e8156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff37da4d-12b7-415b-82cf-b422c7e8156a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb01f05-426f-435e-848f-ceed3efefbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb01f05-426f-435e-848f-ceed3efefbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5e7137-b125-4594-b821-177c39d43312', 'volume_name': 'volume-7a5e7137-b125-4594-b821-177c39d43312', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab16c05-e514-437b-81d0-8072c3619aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab16c05-e514-437b-81d0-8072c3619aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd826cae-9543-44f8-b019-f4221cdf55df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:26 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Volume 7a5e7137-b125-4594-b821-177c39d43312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5e7137-b125-4594-b821-177c39d43312', 'volume_size': 1} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3142558c-50df-4bfb-9693-1b6474e701bd,created_at=2026-02-26T02:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1693803575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3142558c-50df-4bfb-9693-1b6474e701bd,host='devstack@QuobyteHD#QuobyteHD',id=7a5e7137-b125-4594-b821-177c39d43312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85273bfd5dd341e4a33d88154aaa79fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:27Z,use_quota=True,user_id='d3b3fe86138c4d71b2f39472ce2c5ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84e31f58-19d4-4f8f-af15-5498b96f82d2),volume_type_id=84e31f58-19d4-4f8f-af15-5498b96f82d2)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Creating volume 7a5e7137-b125-4594-b821-177c39d43312 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:23:26 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:23:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:26 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312 1073741824 Feb 26 03:23:26 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:27 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312 1073741824" returned: 0 in 0.441s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:27 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312 Feb 26 03:23:27 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:27 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312" returned: 0 in 0.382s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd826cae-9543-44f8-b019-f4221cdf55df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5e7137-b125-4594-b821-177c39d43312', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a272d8ca-b9b9-40ba-8a59-3311e7daeaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:27 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Volume volume-7a5e7137-b125-4594-b821-177c39d43312 (7a5e7137-b125-4594-b821-177c39d43312): created successfully Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a272d8ca-b9b9-40ba-8a59-3311e7daeaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Flow 'volume_create_manager' (c2b75e50-88a1-465b-865f-df27866365ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:27 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3eb2ddd7-026e-4ebd-ba33-6eaf6a92f616 tempest-GroupsTest-417772462 None] Created volume successfully. Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Acquiring lock "cinder-quobyte-7a5e7137-b125-4594-b821-177c39d43312" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Lock "cinder-quobyte-7a5e7137-b125-4594-b821-177c39d43312" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[371eff51-af1a-4a64-9417-fd6e3a394b86]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:23:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:28 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312 Feb 26 03:23:28 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:28 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312" returned: 0 in 0.437s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:28 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312 Feb 26 03:23:28 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:28 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7a5e7137-b125-4594-b821-177c39d43312" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Lock "cinder-quobyte-7a5e7137-b125-4594-b821-177c39d43312" released by "delete_volume" :: held 0.842s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Created reservations ['9b713a4e-1780-4dde-b852-5df022f2af4a'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:28 devstack cinder-volume[83121]: WARNING cinder.quota [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1387922696 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1387922696, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:23:28 devstack cinder-volume[83121]: WARNING cinder.quota [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1387922696 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1387922696, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Created reservations ['f7d669d8-84c4-4549-aa00-25048dfecc61', '6f440a68-a81a-4219-a310-d4b5b4f23e10', 'b9d4704a-6d65-4a7c-a5d5-3a55ffe94b7f', 'edd69c00-dca8-406d-a058-d4a32781934d'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:28 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:23:28 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-1bd9e031-2f47-4b57-afa1-5ca24cbd752d tempest-GroupsTest-417772462 None] Created reservations ['def928db-6592-430e-a9f8-de2315d9a41a'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1bd9e031-2f47-4b57-afa1-5ca24cbd752d tempest-GroupsTest-417772462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1bd9e031-2f47-4b57-afa1-5ca24cbd752d tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1bd9e031-2f47-4b57-afa1-5ca24cbd752d tempest-GroupsTest-417772462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1bd9e031-2f47-4b57-afa1-5ca24cbd752d tempest-GroupsTest-417772462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1bd9e031-2f47-4b57-afa1-5ca24cbd752d tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1bd9e031-2f47-4b57-afa1-5ca24cbd752d tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:29 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:23:29 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:29 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.416s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:23:29 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-134bdef5-fc64-4fe9-9c66-7bc739f37725 tempest-GroupsTest-417772462 None] Delete group completed successfully. Feb 26 03:23:29 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1bd9e031-2f47-4b57-afa1-5ca24cbd752d tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.376s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:29 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-1bd9e031-2f47-4b57-afa1-5ca24cbd752d tempest-GroupsTest-417772462 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:23:29 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-1bd9e031-2f47-4b57-afa1-5ca24cbd752d tempest-GroupsTest-417772462 None] Delete group completed successfully. Feb 26 03:23:30 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8a4f698e-4230-4668-9fbf-36588e9a3ee2 tempest-GroupsTest-417772462 None] Group tempest-GroupsTest-Group-1438306147: creating Feb 26 03:23:30 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8a4f698e-4230-4668-9fbf-36588e9a3ee2 tempest-GroupsTest-417772462 None] Group tempest-GroupsTest-Group-1438306147: created successfully Feb 26 03:23:30 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-8a4f698e-4230-4668-9fbf-36588e9a3ee2 tempest-GroupsTest-417772462 None] Create group completed successfully. Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Flow 'volume_create_manager' (66ce86d5-23d7-4fb6-83ba-a86edbda2260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88829c56-a061-48db-8a6f-fbbfdeca49f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88829c56-a061-48db-8a6f-fbbfdeca49f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1319879071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a2a7591-d588-47e0-87f3-213b07867011,host='devstack@QuobyteHD#QuobyteHD',id=8954bd15-ffcc-4721-a364-7371ea7b7020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85273bfd5dd341e4a33d88154aaa79fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:32Z,use_quota=True,user_id='d3b3fe86138c4d71b2f39472ce2c5ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a568b5-d51b-48ad-9248-4e1abc88b664),volume_type_id=f3a568b5-d51b-48ad-9248-4e1abc88b664)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ea6f33-da56-4169-a028-976f3f416c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ea6f33-da56-4169-a028-976f3f416c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5496dd4c-4f8a-4b20-9342-c53a7bcfdf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5496dd4c-4f8a-4b20-9342-c53a7bcfdf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8954bd15-ffcc-4721-a364-7371ea7b7020', 'volume_name': 'volume-8954bd15-ffcc-4721-a364-7371ea7b7020', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fddb830-fb9d-47c2-bbf2-7da614be4ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fddb830-fb9d-47c2-bbf2-7da614be4ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b304d69-608e-4ad6-95e9-b82e4418919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:31 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Volume 8954bd15-ffcc-4721-a364-7371ea7b7020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8954bd15-ffcc-4721-a364-7371ea7b7020', 'volume_size': 1} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a2a7591-d588-47e0-87f3-213b07867011,created_at=2026-02-26T02:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1319879071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a2a7591-d588-47e0-87f3-213b07867011,host='devstack@QuobyteHD#QuobyteHD',id=8954bd15-ffcc-4721-a364-7371ea7b7020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85273bfd5dd341e4a33d88154aaa79fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:32Z,use_quota=True,user_id='d3b3fe86138c4d71b2f39472ce2c5ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a568b5-d51b-48ad-9248-4e1abc88b664),volume_type_id=f3a568b5-d51b-48ad-9248-4e1abc88b664)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Creating volume 8954bd15-ffcc-4721-a364-7371ea7b7020 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:23:31 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:23:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:31 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020 1073741824 Feb 26 03:23:31 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:32 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:23:32 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:32 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020 1073741824" returned: 0 in 0.430s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:32 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020 Feb 26 03:23:32 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:32 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.399s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:23:32 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020" returned: 0 in 0.374s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b304d69-608e-4ad6-95e9-b82e4418919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8954bd15-ffcc-4721-a364-7371ea7b7020', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf93a35-4d61-47bf-b9f5-e6b53e79e0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:32 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Volume volume-8954bd15-ffcc-4721-a364-7371ea7b7020 (8954bd15-ffcc-4721-a364-7371ea7b7020): created successfully Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf93a35-4d61-47bf-b9f5-e6b53e79e0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Flow 'volume_create_manager' (66ce86d5-23d7-4fb6-83ba-a86edbda2260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:32 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f8607316-62cf-41be-9a71-aef17bbb33c4 tempest-GroupsTest-417772462 None] Created volume successfully. Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Flow 'volume_create_manager' (226da0f2-f263-4efe-8ec3-32dde89fe3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602ea2b0-b210-4017-b993-9d1a8941a4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602ea2b0-b210-4017-b993-9d1a8941a4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248341544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a2a7591-d588-47e0-87f3-213b07867011,host='devstack@QuobyteHD#QuobyteHD',id=2b16052f-90f0-4468-9016-d7acf6bc7d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85273bfd5dd341e4a33d88154aaa79fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:33Z,use_quota=True,user_id='d3b3fe86138c4d71b2f39472ce2c5ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a568b5-d51b-48ad-9248-4e1abc88b664),volume_type_id=f3a568b5-d51b-48ad-9248-4e1abc88b664)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74649df9-6ccc-449c-aa3c-7a6dff303da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74649df9-6ccc-449c-aa3c-7a6dff303da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e034c88-f8f9-4a6b-9c93-8ab0f0a65ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e034c88-f8f9-4a6b-9c93-8ab0f0a65ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b16052f-90f0-4468-9016-d7acf6bc7d2b', 'volume_name': 'volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a7a41c-fdb0-4918-acca-c8ba92791c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a7a41c-fdb0-4918-acca-c8ba92791c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5d3a78-4189-490b-ba79-14fdaac6b692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:33 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Volume 2b16052f-90f0-4468-9016-d7acf6bc7d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b', 'volume_size': 1} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a2a7591-d588-47e0-87f3-213b07867011,created_at=2026-02-26T02:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248341544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a2a7591-d588-47e0-87f3-213b07867011,host='devstack@QuobyteHD#QuobyteHD',id=2b16052f-90f0-4468-9016-d7acf6bc7d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85273bfd5dd341e4a33d88154aaa79fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:33Z,use_quota=True,user_id='d3b3fe86138c4d71b2f39472ce2c5ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a568b5-d51b-48ad-9248-4e1abc88b664),volume_type_id=f3a568b5-d51b-48ad-9248-4e1abc88b664)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Creating volume 2b16052f-90f0-4468-9016-d7acf6bc7d2b {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:23:33 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:33 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b 1073741824 Feb 26 03:23:33 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:33 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b 1073741824" returned: 0 in 0.429s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:33 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b Feb 26 03:23:33 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:34 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b" returned: 0 in 0.400s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:23:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5d3a78-4189-490b-ba79-14fdaac6b692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ec3c34-01f6-453d-bc29-059a74b23ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:34 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Volume volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b (2b16052f-90f0-4468-9016-d7acf6bc7d2b): created successfully Feb 26 03:23:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ec3c34-01f6-453d-bc29-059a74b23ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Flow 'volume_create_manager' (226da0f2-f263-4efe-8ec3-32dde89fe3b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:34 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-35df7bdf-80e5-481c-8bec-e7597b8b148b tempest-GroupsTest-417772462 None] Created volume successfully. Feb 26 03:23:34 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0598889c-efce-4506-886b-7c2147e85b93 tempest-GroupsTest-417772462 None] Update group completed successfully. Feb 26 03:23:35 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5e28bd8d-bb02-4e33-9f0e-c6e8cfac4af0 tempest-GroupsTest-417772462 None] Update group completed successfully. Feb 26 03:23:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Acquiring lock "cinder-quobyte-2b16052f-90f0-4468-9016-d7acf6bc7d2b" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:23:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Lock "cinder-quobyte-2b16052f-90f0-4468-9016-d7acf6bc7d2b" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:23:36 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[361c8148-6f6d-4dff-9cf0-5b1fd49c96e0]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:23:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:36 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b Feb 26 03:23:36 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:37 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b" returned: 0 in 0.441s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:37 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b Feb 26 03:23:37 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:37 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-2b16052f-90f0-4468-9016-d7acf6bc7d2b" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Lock "cinder-quobyte-2b16052f-90f0-4468-9016-d7acf6bc7d2b" released by "delete_volume" :: held 0.842s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:23:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Acquiring lock "cinder-quobyte-8954bd15-ffcc-4721-a364-7371ea7b7020" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:23:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Lock "cinder-quobyte-8954bd15-ffcc-4721-a364-7371ea7b7020" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:23:37 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fc0419-5f68-4ee5-ad38-05c4b3dc91a5]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:23:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:37 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020 Feb 26 03:23:37 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:38 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020" returned: 0 in 0.436s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:38 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020 Feb 26 03:23:38 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:38 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8954bd15-ffcc-4721-a364-7371ea7b7020" returned: 0 in 0.371s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Lock "cinder-quobyte-8954bd15-ffcc-4721-a364-7371ea7b7020" released by "delete_volume" :: held 0.825s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Created reservations ['bb693fec-df9f-4383-9c23-cc916f02c27a'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:38 devstack cinder-volume[83121]: WARNING cinder.quota [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-365873064 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-365873064, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:23:38 devstack cinder-volume[83121]: WARNING cinder.quota [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-365873064 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-365873064, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Created reservations ['d42e597d-1a56-427f-992a-6196a9ab1b68', 'aac78a86-7bd2-4fe1-99c7-901cf4f09937', 'f8057c2e-f2fb-4f9b-bf0b-735fecb9a643', '2ce4fe26-ee8d-430f-b159-82f7bf9213d7'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Created reservations ['b461f4eb-696a-4e98-9374-0bd1f0b35901', '576d0896-5a7d-4052-9410-c54f165604ea', '00b025c6-60e1-4dd3-973d-65b920446f0e', '77324958-a420-4af8-885e-ad5f2e78e201'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:38 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:23:38 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:38 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.413s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:38 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:23:38 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a22ba663-5bd4-47b9-9085-d56f9d8d49a5 tempest-GroupsTest-417772462 None] Delete group completed successfully. Feb 26 03:23:41 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-887037b7-0f38-4cd5-af05-e80bca230515 tempest-GroupsV320Test-1357770025 None] Group tempest-GroupsV320Test-Group-155454653: creating Feb 26 03:23:41 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-887037b7-0f38-4cd5-af05-e80bca230515 tempest-GroupsV320Test-1357770025 None] Group tempest-GroupsV320Test-Group-155454653: created successfully Feb 26 03:23:41 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-887037b7-0f38-4cd5-af05-e80bca230515 tempest-GroupsV320Test-1357770025 None] Create group completed successfully. Feb 26 03:23:42 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-22ac7c64-cdb9-4dbe-868c-6afb4b115f00 tempest-GroupsV320Test-1357770025 None] Created reservations ['f6c84152-d186-487a-b2bb-17b94082bc82'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-22ac7c64-cdb9-4dbe-868c-6afb4b115f00 tempest-GroupsV320Test-1357770025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-22ac7c64-cdb9-4dbe-868c-6afb4b115f00 tempest-GroupsV320Test-1357770025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-22ac7c64-cdb9-4dbe-868c-6afb4b115f00 tempest-GroupsV320Test-1357770025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-22ac7c64-cdb9-4dbe-868c-6afb4b115f00 tempest-GroupsV320Test-1357770025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-22ac7c64-cdb9-4dbe-868c-6afb4b115f00 tempest-GroupsV320Test-1357770025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22ac7c64-cdb9-4dbe-868c-6afb4b115f00 tempest-GroupsV320Test-1357770025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:42 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:23:42 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:43 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-22ac7c64-cdb9-4dbe-868c-6afb4b115f00 tempest-GroupsV320Test-1357770025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.370s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:43 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-22ac7c64-cdb9-4dbe-868c-6afb4b115f00 tempest-GroupsV320Test-1357770025 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:23:43 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-22ac7c64-cdb9-4dbe-868c-6afb4b115f00 tempest-GroupsV320Test-1357770025 None] Delete group completed successfully. Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Flow 'volume_create_manager' (276eae7b-c541-40bd-b4c8-8803f164cf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd78626-3262-444b-bfad-3b829a40bd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd78626-3262-444b-bfad-3b829a40bd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1537456632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a26c812-e53d-4b6a-a127-d0c5d6fc0007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48075e8a77b740eb987397c000de2b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:47Z,use_quota=True,user_id='77c310d25f984c5fb3d96283a3a225de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aed0028f-abb7-4215-82ca-542edcb3cda7),volume_type_id=aed0028f-abb7-4215-82ca-542edcb3cda7)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b83cfd-5491-4ba3-8fa6-b013ddae3195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b83cfd-5491-4ba3-8fa6-b013ddae3195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef46d37-a1ba-48ad-99fe-7f4400e9112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef46d37-a1ba-48ad-99fe-7f4400e9112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a26c812-e53d-4b6a-a127-d0c5d6fc0007', 'volume_name': 'volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c8d02a-63ed-440c-9670-ef4565eba644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c8d02a-63ed-440c-9670-ef4565eba644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46a2d82-8f26-47c7-8e05-ef5dfcee8d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:46 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Volume 3a26c812-e53d-4b6a-a127-d0c5d6fc0007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007', 'volume_size': 1} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1537456632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a26c812-e53d-4b6a-a127-d0c5d6fc0007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48075e8a77b740eb987397c000de2b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:23:47Z,use_quota=True,user_id='77c310d25f984c5fb3d96283a3a225de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aed0028f-abb7-4215-82ca-542edcb3cda7),volume_type_id=aed0028f-abb7-4215-82ca-542edcb3cda7)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Creating volume 3a26c812-e53d-4b6a-a127-d0c5d6fc0007 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:23:46 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:23:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:46 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007 1073741824 Feb 26 03:23:46 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:47 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007 1073741824" returned: 0 in 0.445s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:47 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007 Feb 26 03:23:47 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:47 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007" returned: 0 in 0.382s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46a2d82-8f26-47c7-8e05-ef5dfcee8d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd740746-d239-4687-806b-bf0513171182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:23:47 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Volume volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007 (3a26c812-e53d-4b6a-a127-d0c5d6fc0007): created successfully Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd740746-d239-4687-806b-bf0513171182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Flow 'volume_create_manager' (276eae7b-c541-40bd-b4c8-8803f164cf8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:23:47 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a35030b5-b4ba-4de8-908b-593172bea319 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Created volume successfully. Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e63c3fef-da19-42ba-a2fb-2761de901f41 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e63c3fef-da19-42ba-a2fb-2761de901f41 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e63c3fef-da19-42ba-a2fb-2761de901f41 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e63c3fef-da19-42ba-a2fb-2761de901f41 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e63c3fef-da19-42ba-a2fb-2761de901f41 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e63c3fef-da19-42ba-a2fb-2761de901f41 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:47 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:23:47 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:48 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e63c3fef-da19-42ba-a2fb-2761de901f41 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.378s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:48 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-e63c3fef-da19-42ba-a2fb-2761de901f41 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:23:48 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e63c3fef-da19-42ba-a2fb-2761de901f41 tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Retype volume completed successfully. Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Acquiring lock "cinder-3a26c812-e53d-4b6a-a127-d0c5d6fc0007-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "cinder-3a26c812-e53d-4b6a-a127-d0c5d6fc0007-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=84,cinder:UPDATE=79,cinder:INSERT=22,cinder:DELETE=5 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=104,cinder:SELECT=100,cinder:INSERT=14,cinder:DELETE=2 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Acquiring lock "cinder-quobyte-3a26c812-e53d-4b6a-a127-d0c5d6fc0007" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "cinder-quobyte-3a26c812-e53d-4b6a-a127-d0c5d6fc0007" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4a1882-fa9b-433e-b3cd-0f921dec7af4]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:49 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007 Feb 26 03:23:49 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:49 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007" returned: 0 in 0.436s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:49 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007 Feb 26 03:23:49 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:49 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-3a26c812-e53d-4b6a-a127-d0c5d6fc0007" returned: 0 in 0.373s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "cinder-quobyte-3a26c812-e53d-4b6a-a127-d0c5d6fc0007" released by "delete_volume" :: held 0.828s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:23:49 devstack cinder-volume[83121]: WARNING cinder.quota [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:23:49 devstack cinder-volume[83121]: WARNING cinder.quota [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Created reservations ['4f54e487-afa0-4841-850d-f550496209a9', '3344de37-a039-46cd-b4c9-f3034f6f5204', '90d64c0c-e2e5-47f8-b98a-543600a50f2b', '7b66d68e-9a6b-4bf1-95ee-99eef1e15030'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:23:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:23:49 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:23:49 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:23:50 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Feb 26 03:23:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.439s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:23:50 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:23:50 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Deleted volume successfully. Feb 26 03:23:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-34be414c-1e5e-407a-ab4d-5370f7771c0b tempest-VolumeRetypeWithoutMigrationTest-319236505 None] Lock "cinder-3a26c812-e53d-4b6a-a127-d0c5d6fc0007-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:23:59 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=11 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:24:00 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:24:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:24:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:24:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:24:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:24:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:24:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:24:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:24:32 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:24:32 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:24:32 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Feb 26 03:24:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.372s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:24:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:25:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:25:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:25:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:25:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:25:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:25:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:25:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:25:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:25:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:25:32 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:25:32 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:25:32 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Feb 26 03:25:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.392s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:25:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:26:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:26:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:26:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:26:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:26:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:26:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:26:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:26:32 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:26:32 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:26:32 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Feb 26 03:26:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.379s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:26:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:27:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:27:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:27:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:27:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:27:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:27:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:27:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:27:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:27:32 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:27:32 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:27:32 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Feb 26 03:27:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.370s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:27:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:28:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:28:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:28:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:28:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:28:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:28:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:28:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:28:32 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:28:32 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:28:32 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Feb 26 03:28:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.363s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:28:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:29:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:29:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Flow 'volume_create_manager' (caff126c-ef07-4547-adc9-98325b757eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b7e7e1-b0ae-4945-9310-95c48b29e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b7e7e1-b0ae-4945-9310-95c48b29e835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354694388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7261f085-d2b7-4517-8203-08ae12e67c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52de2e5f2a2b416e8e3cc3397c771599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:26Z,use_quota=True,user_id='dc46160fd7834c9581ec24c72d56bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60db1be-b7a9-4dd7-bfb5-285a2da7c6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60db1be-b7a9-4dd7-bfb5-285a2da7c6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcebb61-b19d-4ed2-bbcd-213e7bab0ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcebb61-b19d-4ed2-bbcd-213e7bab0ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7261f085-d2b7-4517-8203-08ae12e67c5a', 'volume_name': 'volume-7261f085-d2b7-4517-8203-08ae12e67c5a', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14de1f9a-7337-4bc5-976b-7f83031928a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14de1f9a-7337-4bc5-976b-7f83031928a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389f0f10-9954-4471-907f-046b7ecfe7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:25 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Volume 7261f085-d2b7-4517-8203-08ae12e67c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7261f085-d2b7-4517-8203-08ae12e67c5a', 'volume_size': 1} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354694388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7261f085-d2b7-4517-8203-08ae12e67c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52de2e5f2a2b416e8e3cc3397c771599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:26Z,use_quota=True,user_id='dc46160fd7834c9581ec24c72d56bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Creating volume 7261f085-d2b7-4517-8203-08ae12e67c5a {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:29:25 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:29:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:25 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a 1073741824 Feb 26 03:29:25 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:26 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a 1073741824" returned: 0 in 0.439s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:26 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a Feb 26 03:29:26 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:26 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a" returned: 0 in 0.367s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:29:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389f0f10-9954-4471-907f-046b7ecfe7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7261f085-d2b7-4517-8203-08ae12e67c5a', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09fcd39-ab89-4476-b5a7-f34c6ae0e70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:26 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Volume volume-7261f085-d2b7-4517-8203-08ae12e67c5a (7261f085-d2b7-4517-8203-08ae12e67c5a): created successfully Feb 26 03:29:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09fcd39-ab89-4476-b5a7-f34c6ae0e70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Flow 'volume_create_manager' (caff126c-ef07-4547-adc9-98325b757eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-27953888-c668-4fe7-af18-67e8d7c94b61 tempest-VolumesActionsTest-1100229290 None] Created volume successfully. Feb 26 03:29:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Acquiring lock "cinder-7261f085-d2b7-4517-8203-08ae12e67c5a-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Lock "cinder-7261f085-d2b7-4517-8203-08ae12e67c5a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Acquiring lock "cinder-quobyte-7261f085-d2b7-4517-8203-08ae12e67c5a" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Lock "cinder-quobyte-7261f085-d2b7-4517-8203-08ae12e67c5a" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:27 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8390b7f7-8686-4f73-91e6-a9e8e7be0220]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:29:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:27 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a Feb 26 03:29:27 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:27 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:27 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a Feb 26 03:29:27 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:28 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7261f085-d2b7-4517-8203-08ae12e67c5a" returned: 0 in 0.384s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Lock "cinder-quobyte-7261f085-d2b7-4517-8203-08ae12e67c5a" released by "delete_volume" :: held 0.841s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Created reservations ['8de03303-3ea3-4f0a-9c87-be22e58eb339', '3093da32-885f-4f23-a3fc-54ed1d836b46', 'c70dbade-b8d4-4928-a316-30dda569b7a2', '0a0b8490-59ec-49f4-a9c2-45433f51ebaf'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:28 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:29:28 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Flow 'volume_create_manager' (771d94b6-9c94-44ae-b1c3-5ebb272ff175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec292c26-d4b6-43e8-a93a-b32bda004684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:28 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.430s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec292c26-d4b6-43e8-a93a-b32bda004684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-878024935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f560337-aef4-4424-960a-ed848fe21344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52de2e5f2a2b416e8e3cc3397c771599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:28Z,use_quota=True,user_id='dc46160fd7834c9581ec24c72d56bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640a4d96-2efc-4698-a139-b19f56733ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640a4d96-2efc-4698-a139-b19f56733ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae281d3-fc84-43cd-bea7-f7789e92db15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae281d3-fc84-43cd-bea7-f7789e92db15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f560337-aef4-4424-960a-ed848fe21344', 'volume_name': 'volume-1f560337-aef4-4424-960a-ed848fe21344', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf28772-732b-4bca-b0de-2885c98b895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf28772-732b-4bca-b0de-2885c98b895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35804f0b-0953-4ccc-8ecb-df0e5f8d6391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:28 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Volume 1f560337-aef4-4424-960a-ed848fe21344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f560337-aef4-4424-960a-ed848fe21344', 'volume_size': 1} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-878024935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f560337-aef4-4424-960a-ed848fe21344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52de2e5f2a2b416e8e3cc3397c771599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:28Z,use_quota=True,user_id='dc46160fd7834c9581ec24c72d56bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Creating volume 1f560337-aef4-4424-960a-ed848fe21344 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:29:28 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:29:28 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Deleted volume successfully. Feb 26 03:29:28 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344 1073741824 Feb 26 03:29:28 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:28 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-6c2af5ed-9871-4433-afbd-18604c3cde75 tempest-VolumesActionsTest-1546165534 None] Lock "cinder-7261f085-d2b7-4517-8203-08ae12e67c5a-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:29 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344 1073741824" returned: 0 in 0.452s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:29 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344 Feb 26 03:29:29 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:29 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344" returned: 0 in 0.369s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35804f0b-0953-4ccc-8ecb-df0e5f8d6391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f560337-aef4-4424-960a-ed848fe21344', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671c84c4-6b82-412f-8ce4-7693199ae71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:29 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Volume volume-1f560337-aef4-4424-960a-ed848fe21344 (1f560337-aef4-4424-960a-ed848fe21344): created successfully Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671c84c4-6b82-412f-8ce4-7693199ae71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Flow 'volume_create_manager' (771d94b6-9c94-44ae-b1c3-5ebb272ff175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:29 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e8df2509-4830-4f09-a96c-dfdc489e580f tempest-VolumesActionsTest-1100229290 None] Created volume successfully. Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Acquiring lock "cinder-1f560337-aef4-4424-960a-ed848fe21344-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Lock "cinder-1f560337-aef4-4424-960a-ed848fe21344-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Acquiring lock "cinder-quobyte-1f560337-aef4-4424-960a-ed848fe21344" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Lock "cinder-quobyte-1f560337-aef4-4424-960a-ed848fe21344" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[805c2690-fc51-479e-9aa2-e4071a243456]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:29:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:29 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344 Feb 26 03:29:29 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:30 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344" returned: 0 in 0.431s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:30 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344 Feb 26 03:29:30 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:30 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1f560337-aef4-4424-960a-ed848fe21344" returned: 0 in 0.366s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Lock "cinder-quobyte-1f560337-aef4-4424-960a-ed848fe21344" released by "delete_volume" :: held 0.815s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Created reservations ['e867f45c-289e-4b40-9bf1-a901a496909d', '4d96b142-c187-4250-8160-f575879abff7', '4fd24576-de3f-4a45-b70b-6ee15123190c', 'adf25972-23db-42ee-9b2f-8007bdbb6f00'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:30 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:29:30 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:29:31 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Flow 'volume_create_manager' (8e112672-4450-49a3-bc43-1abcbf790c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f597e78-1645-475c-bb0e-9963ad0fb32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.449s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:29:31 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Deleted volume successfully. Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f597e78-1645-475c-bb0e-9963ad0fb32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519363323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e296f6c8-fe64-4a31-bd39-c3b704526f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52de2e5f2a2b416e8e3cc3397c771599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:31Z,use_quota=True,user_id='dc46160fd7834c9581ec24c72d56bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2095cac-be1b-4c46-a4d2-053efb97134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2095cac-be1b-4c46-a4d2-053efb97134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0001b9d-a836-46d2-99ec-529dd6d1d913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0001b9d-a836-46d2-99ec-529dd6d1d913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e296f6c8-fe64-4a31-bd39-c3b704526f81', 'volume_name': 'volume-e296f6c8-fe64-4a31-bd39-c3b704526f81', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12b0907-40bb-40b2-819d-2f447f8d4fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12b0907-40bb-40b2-819d-2f447f8d4fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736ab519-7e5a-4848-885b-2ea62739689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:31 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Volume e296f6c8-fe64-4a31-bd39-c3b704526f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e296f6c8-fe64-4a31-bd39-c3b704526f81', 'volume_size': 1} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519363323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e296f6c8-fe64-4a31-bd39-c3b704526f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52de2e5f2a2b416e8e3cc3397c771599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:31Z,use_quota=True,user_id='dc46160fd7834c9581ec24c72d56bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Creating volume e296f6c8-fe64-4a31-bd39-c3b704526f81 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:29:31 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-82d392be-59ff-4d25-a545-b53fb231fb2d tempest-VolumesActionsTest-1546165534 None] Lock "cinder-1f560337-aef4-4424-960a-ed848fe21344-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:31 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81 1073741824 Feb 26 03:29:31 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:31 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81 1073741824" returned: 0 in 0.428s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:31 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81 Feb 26 03:29:31 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:31 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81" returned: 0 in 0.364s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736ab519-7e5a-4848-885b-2ea62739689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e296f6c8-fe64-4a31-bd39-c3b704526f81', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb776ff-09e8-4533-9e72-9dc3e502443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:31 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Volume volume-e296f6c8-fe64-4a31-bd39-c3b704526f81 (e296f6c8-fe64-4a31-bd39-c3b704526f81): created successfully Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb776ff-09e8-4533-9e72-9dc3e502443e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Flow 'volume_create_manager' (8e112672-4450-49a3-bc43-1abcbf790c8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:31 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-d1154566-c154-4c36-9e8e-1bac54124bcf tempest-VolumesActionsTest-1100229290 None] Created volume successfully. Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:32 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:29:32 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Acquiring lock "cinder-e296f6c8-fe64-4a31-bd39-c3b704526f81-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Lock "cinder-e296f6c8-fe64-4a31-bd39-c3b704526f81-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Acquiring lock "cinder-quobyte-e296f6c8-fe64-4a31-bd39-c3b704526f81" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Lock "cinder-quobyte-e296f6c8-fe64-4a31-bd39-c3b704526f81" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b721e090-d5e6-4c4b-a5a1-47b6f08190f4]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:32 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81 Feb 26 03:29:32 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:32 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.396s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:29:32 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81" returned: 0 in 0.425s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:32 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81 Feb 26 03:29:32 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:33 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e296f6c8-fe64-4a31-bd39-c3b704526f81" returned: 0 in 0.374s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Lock "cinder-quobyte-e296f6c8-fe64-4a31-bd39-c3b704526f81" released by "delete_volume" :: held 0.824s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Created reservations ['79872a03-394f-43a7-a6b5-b45805412a4b', 'bd89b216-3e84-42d5-b77b-db6fad7a2ecc', '78952306-c70d-4e2e-ad4b-1c694e899832', 'd79e9c1b-140b-4271-97c3-9337ac20e415'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:33 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:29:33 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:29:33 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Flow 'volume_create_manager' (c640de82-64f3-4c1a-86a1-db14da8313b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d42c50-0947-433a-ae9c-92217d8338cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.438s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:29:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Deleted volume successfully. Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d42c50-0947-433a-ae9c-92217d8338cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1268970729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c8b177-451d-41c9-906e-c3664867845b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52de2e5f2a2b416e8e3cc3397c771599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:34Z,use_quota=True,user_id='dc46160fd7834c9581ec24c72d56bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337a9a39-e39a-4082-936c-3f69eed2059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337a9a39-e39a-4082-936c-3f69eed2059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1291ceff-edea-4788-988d-42f1bff7beb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1291ceff-edea-4788-988d-42f1bff7beb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c8b177-451d-41c9-906e-c3664867845b', 'volume_name': 'volume-04c8b177-451d-41c9-906e-c3664867845b', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effbe5c2-d9fe-433c-ae58-dab7d0b51a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effbe5c2-d9fe-433c-ae58-dab7d0b51a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02507d3b-cee9-4a1d-92ae-3e62687fe708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:33 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Volume 04c8b177-451d-41c9-906e-c3664867845b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c8b177-451d-41c9-906e-c3664867845b', 'volume_size': 1} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1268970729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c8b177-451d-41c9-906e-c3664867845b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52de2e5f2a2b416e8e3cc3397c771599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:34Z,use_quota=True,user_id='dc46160fd7834c9581ec24c72d56bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Creating volume 04c8b177-451d-41c9-906e-c3664867845b {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:29:33 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4b4351f6-c928-49fe-82ca-b5b97f20d60a tempest-VolumesActionsTest-1546165534 None] Lock "cinder-e296f6c8-fe64-4a31-bd39-c3b704526f81-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:33 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b 1073741824 Feb 26 03:29:33 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:34 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b 1073741824" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:34 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b Feb 26 03:29:34 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:34 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02507d3b-cee9-4a1d-92ae-3e62687fe708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c8b177-451d-41c9-906e-c3664867845b', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ddf141-77f3-436e-86f4-de5a9aa38971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:34 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Volume volume-04c8b177-451d-41c9-906e-c3664867845b (04c8b177-451d-41c9-906e-c3664867845b): created successfully Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ddf141-77f3-436e-86f4-de5a9aa38971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Flow 'volume_create_manager' (c640de82-64f3-4c1a-86a1-db14da8313b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:34 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5a4a44f9-8408-4cdb-ac3a-17a6445a6df3 tempest-VolumesActionsTest-1100229290 None] Created volume successfully. Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Acquiring lock "cinder-04c8b177-451d-41c9-906e-c3664867845b-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Lock "cinder-04c8b177-451d-41c9-906e-c3664867845b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Acquiring lock "cinder-quobyte-04c8b177-451d-41c9-906e-c3664867845b" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Lock "cinder-quobyte-04c8b177-451d-41c9-906e-c3664867845b" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b604fe0a-977d-43fa-82b4-e96c089b4bba]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:29:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:34 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b Feb 26 03:29:34 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:35 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b" returned: 0 in 0.438s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:35 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b Feb 26 03:29:35 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:35 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-04c8b177-451d-41c9-906e-c3664867845b" returned: 0 in 0.373s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Lock "cinder-quobyte-04c8b177-451d-41c9-906e-c3664867845b" released by "delete_volume" :: held 0.834s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Created reservations ['8809b7d5-f3fe-4146-a8c8-0b1c5adca29b', 'bbc2a41c-478c-4dd9-831c-0dcac4b6cb17', 'f49fd3fd-4ef3-497a-9799-47e81133cfd8', '9c65aaa3-51ce-4854-80d2-c28031e287e7'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:35 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:35 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:29:35 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:36 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.405s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Flow 'volume_create_manager' (c633eb8c-a73a-4521-b168-2114394cdc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea4862d-5359-4fa3-a068-db36edfb117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:36 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Deleted volume successfully. Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea4862d-5359-4fa3-a068-db36edfb117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-570955307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cafb79a-d890-415d-b0b1-2b1cde937fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52de2e5f2a2b416e8e3cc3397c771599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:36Z,use_quota=True,user_id='dc46160fd7834c9581ec24c72d56bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1eff94-a84d-4c9b-8c70-1328891c4b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1eff94-a84d-4c9b-8c70-1328891c4b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e5e27d-bf1d-4d4b-88ca-75d5caded440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e5e27d-bf1d-4d4b-88ca-75d5caded440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cafb79a-d890-415d-b0b1-2b1cde937fb3', 'volume_name': 'volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b7991c5-203c-4d98-add3-0ff2105381c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b7991c5-203c-4d98-add3-0ff2105381c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd11310-63dd-4b7a-b121-2b8be3653ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:36 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Volume 7cafb79a-d890-415d-b0b1-2b1cde937fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3', 'volume_size': 1} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-570955307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cafb79a-d890-415d-b0b1-2b1cde937fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52de2e5f2a2b416e8e3cc3397c771599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:36Z,use_quota=True,user_id='dc46160fd7834c9581ec24c72d56bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Creating volume 7cafb79a-d890-415d-b0b1-2b1cde937fb3 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:29:36 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-55a5d399-63a5-4b53-b350-869d4bb0ce97 tempest-VolumesActionsTest-1546165534 None] Lock "cinder-04c8b177-451d-41c9-906e-c3664867845b-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:36 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3 1073741824 Feb 26 03:29:36 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:36 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3 1073741824" returned: 0 in 0.425s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:36 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3 Feb 26 03:29:36 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:36 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3" returned: 0 in 0.377s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd11310-63dd-4b7a-b121-2b8be3653ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f4026b-9392-4aa0-b266-e27d5637fbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:36 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Volume volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3 (7cafb79a-d890-415d-b0b1-2b1cde937fb3): created successfully Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f4026b-9392-4aa0-b266-e27d5637fbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:36 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Flow 'volume_create_manager' (c633eb8c-a73a-4521-b168-2114394cdc9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:36 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-30137265-d984-4e66-b03d-a5671f77d1dd tempest-VolumesActionsTest-1100229290 None] Created volume successfully. Feb 26 03:29:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Acquiring lock "cinder-7cafb79a-d890-415d-b0b1-2b1cde937fb3-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Lock "cinder-7cafb79a-d890-415d-b0b1-2b1cde937fb3-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Acquiring lock "cinder-quobyte-7cafb79a-d890-415d-b0b1-2b1cde937fb3" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Lock "cinder-quobyte-7cafb79a-d890-415d-b0b1-2b1cde937fb3" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:37 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb15fdff-6959-4411-8aa1-471ce9c317f3]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:29:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:37 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3 Feb 26 03:29:37 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:37 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3" returned: 0 in 0.441s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:37 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3 Feb 26 03:29:37 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:38 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7cafb79a-d890-415d-b0b1-2b1cde937fb3" returned: 0 in 0.365s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Lock "cinder-quobyte-7cafb79a-d890-415d-b0b1-2b1cde937fb3" released by "delete_volume" :: held 0.835s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Created reservations ['8dae7ea6-1728-49f8-bbff-8afb5b440890', 'e4d265d1-6bb7-4915-b2f3-da5bdf6acbce', '9e7f69e6-ad37-4850-b35f-45074e8844ab', 'ddcc5175-b1fb-4ab7-a757-501b4337954c'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:38 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:29:38 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:38 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.389s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:29:38 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Deleted volume successfully. Feb 26 03:29:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-128452b8-01c7-4f24-b3b8-5736030807f2 tempest-VolumesActionsTest-1100229290 None] Lock "cinder-7cafb79a-d890-415d-b0b1-2b1cde937fb3-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Flow 'volume_create_manager' (1b7a703c-20e7-4c72-9c12-fbeabe4ffcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58095ef3-6355-4eab-8536-221c45c5afca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58095ef3-6355-4eab-8536-221c45c5afca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-153793039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0826ff-14b7-4773-9118-98a46c8d7fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76557f34f1914bf99081953c85013664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:46Z,use_quota=True,user_id='ddca62cdeabc4678b4a2014308a2ce59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75e6282-7fec-4706-b799-47cdb3b51813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75e6282-7fec-4706-b799-47cdb3b51813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6c837d-a9f5-4bec-bbc4-bf8f6ea68f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6c837d-a9f5-4bec-bbc4-bf8f6ea68f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c0826ff-14b7-4773-9118-98a46c8d7fa6', 'volume_name': 'volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747f53c0-c7e0-4342-ab0f-dd43650c52f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747f53c0-c7e0-4342-ab0f-dd43650c52f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f89d80-42a6-4719-ad7f-3236f8ba375b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:45 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Volume 8c0826ff-14b7-4773-9118-98a46c8d7fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6', 'volume_size': 1} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-153793039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0826ff-14b7-4773-9118-98a46c8d7fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76557f34f1914bf99081953c85013664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:46Z,use_quota=True,user_id='ddca62cdeabc4678b4a2014308a2ce59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Creating volume 8c0826ff-14b7-4773-9118-98a46c8d7fa6 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:29:45 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:29:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:45 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6 1073741824 Feb 26 03:29:45 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:46 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6 1073741824" returned: 0 in 0.436s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:46 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6 Feb 26 03:29:46 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:46 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6" returned: 0 in 0.371s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:29:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f89d80-42a6-4719-ad7f-3236f8ba375b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71370f4a-2032-43c7-b7f6-cc1f83ded7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:46 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Volume volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6 (8c0826ff-14b7-4773-9118-98a46c8d7fa6): created successfully Feb 26 03:29:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71370f4a-2032-43c7-b7f6-cc1f83ded7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:46 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Flow 'volume_create_manager' (1b7a703c-20e7-4c72-9c12-fbeabe4ffcab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:46 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5fa7bddc-4260-4876-bb73-6143486ca7a1 tempest-VolumesTransfersTest-457319472 None] Created volume successfully. Feb 26 03:29:46 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5e691500-fa2e-465e-af10-9f075823dd2a tempest-VolumesTransfersTest-1881221889 None] Transfer volume completed successfully. Feb 26 03:29:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Acquiring lock "cinder-8c0826ff-14b7-4773-9118-98a46c8d7fa6-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Lock "cinder-8c0826ff-14b7-4773-9118-98a46c8d7fa6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Acquiring lock "cinder-quobyte-8c0826ff-14b7-4773-9118-98a46c8d7fa6" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Lock "cinder-quobyte-8c0826ff-14b7-4773-9118-98a46c8d7fa6" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:47 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b26a599-e2ab-4ed2-bd0b-a909c3a1016f]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:29:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:47 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6 Feb 26 03:29:47 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:48 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6" returned: 0 in 0.427s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:48 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6 Feb 26 03:29:48 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:48 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8c0826ff-14b7-4773-9118-98a46c8d7fa6" returned: 0 in 0.372s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Lock "cinder-quobyte-8c0826ff-14b7-4773-9118-98a46c8d7fa6" released by "delete_volume" :: held 0.817s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Created reservations ['5769ad47-ba9f-4a87-9518-1941c058738c', '8ee695bb-3cb7-42a6-ae75-e6bcf3915b57', 'fb3db799-1e03-4261-933c-ce7477265d74', '2d8e1daf-e5e3-49f0-8e33-6b554d252477'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:48 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:29:48 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Flow 'volume_create_manager' (9fa3dc04-1d7c-493b-9b8a-5b9d19131916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97629028-c791-4922-8c0a-74bfba33ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:49 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97629028-c791-4922-8c0a-74bfba33ae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-800517392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a823fc7e-56f4-45e6-a7e6-2b154acfa080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76557f34f1914bf99081953c85013664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:49Z,use_quota=True,user_id='ddca62cdeabc4678b4a2014308a2ce59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0d27e9-daa9-4ab9-90ff-1ee596d9846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0d27e9-daa9-4ab9-90ff-1ee596d9846b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0df25de-a039-4479-b8f0-6befbcce73f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0df25de-a039-4479-b8f0-6befbcce73f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a823fc7e-56f4-45e6-a7e6-2b154acfa080', 'volume_name': 'volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9f4537-bfa3-4163-b8cd-a222009d2756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9f4537-bfa3-4163-b8cd-a222009d2756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e70073-ec57-4647-83dd-19800d28bcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:49 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Volume a823fc7e-56f4-45e6-a7e6-2b154acfa080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080', 'volume_size': 1} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-800517392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a823fc7e-56f4-45e6-a7e6-2b154acfa080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76557f34f1914bf99081953c85013664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:49Z,use_quota=True,user_id='ddca62cdeabc4678b4a2014308a2ce59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Creating volume a823fc7e-56f4-45e6-a7e6-2b154acfa080 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:29:49 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.494s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:29:49 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Deleted volume successfully. Feb 26 03:29:49 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080 1073741824 Feb 26 03:29:49 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-cadcf1d2-2128-4e2a-b8c5-c077925564a2 tempest-VolumesTransfersTest-869384663 None] Lock "cinder-8c0826ff-14b7-4773-9118-98a46c8d7fa6-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:49 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080 1073741824" returned: 0 in 0.425s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:49 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080 Feb 26 03:29:49 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:49 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080" returned: 0 in 0.374s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e70073-ec57-4647-83dd-19800d28bcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2c1704-f4ae-4eb5-9fff-87cd7a11b12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:49 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Volume volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080 (a823fc7e-56f4-45e6-a7e6-2b154acfa080): created successfully Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2c1704-f4ae-4eb5-9fff-87cd7a11b12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:49 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Flow 'volume_create_manager' (9fa3dc04-1d7c-493b-9b8a-5b9d19131916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:49 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b4c7f9cc-1497-45fe-b7f3-563d51cbe03c tempest-VolumesTransfersTest-457319472 None] Created volume successfully. Feb 26 03:29:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Acquiring lock "cinder-a823fc7e-56f4-45e6-a7e6-2b154acfa080-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Lock "cinder-a823fc7e-56f4-45e6-a7e6-2b154acfa080-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Acquiring lock "cinder-quobyte-a823fc7e-56f4-45e6-a7e6-2b154acfa080" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:29:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Lock "cinder-quobyte-a823fc7e-56f4-45e6-a7e6-2b154acfa080" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:29:50 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[75084d9b-364d-42f4-8862-1f6fdc658343]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:29:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:50 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080 Feb 26 03:29:50 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:50 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080" returned: 0 in 0.432s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:50 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080 Feb 26 03:29:50 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:51 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a823fc7e-56f4-45e6-a7e6-2b154acfa080" returned: 0 in 0.366s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Lock "cinder-quobyte-a823fc7e-56f4-45e6-a7e6-2b154acfa080" released by "delete_volume" :: held 0.820s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Created reservations ['8973ad59-97bf-4950-8d4e-8e12a958e82f', '0cd45f75-d769-4a25-a514-a39238baf637', '9af65f7f-0384-4388-a1cf-edc8ded1094c', '59bd1920-70a0-4d42-a041-7fedd6430130'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:51 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:29:51 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:51 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.399s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:29:51 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Deleted volume successfully. Feb 26 03:29:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41b85414-7971-466c-98c4-2f915de74531 tempest-VolumesTransfersTest-869384663 None] Lock "cinder-a823fc7e-56f4-45e6-a7e6-2b154acfa080-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Flow 'volume_create_manager' (9bff12a5-e500-400d-b994-a719701f9d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c71fab-5faa-451d-b991-9050fea7a899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c71fab-5faa-451d-b991-9050fea7a899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1935442296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b753f951-31a4-42ad-97c2-e739b693c843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9100d37a12a430588e954773e55aaa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:55Z,use_quota=True,user_id='c545b57874ce41a28409d3a92e7c5c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5418375-af59-4d49-afba-64f84eb60055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5418375-af59-4d49-afba-64f84eb60055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135c108d-47bb-4f23-925c-97554252d07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135c108d-47bb-4f23-925c-97554252d07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b753f951-31a4-42ad-97c2-e739b693c843', 'volume_name': 'volume-b753f951-31a4-42ad-97c2-e739b693c843', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf65f4d-2fda-4338-9c4f-421f9ed3a6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf65f4d-2fda-4338-9c4f-421f9ed3a6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ff4c35-0b09-4e2c-b395-6e212673f134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:54 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Volume b753f951-31a4-42ad-97c2-e739b693c843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b753f951-31a4-42ad-97c2-e739b693c843', 'volume_size': 1} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1935442296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b753f951-31a4-42ad-97c2-e739b693c843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9100d37a12a430588e954773e55aaa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:29:55Z,use_quota=True,user_id='c545b57874ce41a28409d3a92e7c5c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Creating volume b753f951-31a4-42ad-97c2-e739b693c843 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:29:54 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:29:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:54 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843 1073741824 Feb 26 03:29:54 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:55 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843 1073741824" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:29:55 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843 Feb 26 03:29:55 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:29:55 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Feb 26 03:29:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843" returned: 0 in 0.377s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:29:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:29:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:29:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ff4c35-0b09-4e2c-b395-6e212673f134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b753f951-31a4-42ad-97c2-e739b693c843', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d8135f-585d-4f54-817a-6589c1358c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:29:55 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Volume volume-b753f951-31a4-42ad-97c2-e739b693c843 (b753f951-31a4-42ad-97c2-e739b693c843): created successfully Feb 26 03:29:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d8135f-585d-4f54-817a-6589c1358c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:29:55 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Flow 'volume_create_manager' (9bff12a5-e500-400d-b994-a719701f9d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:29:55 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e8801afb-9122-4070-90f2-b01a0110c022 tempest-VolumesNegativeTest-218564941 None] Created volume successfully. Feb 26 03:30:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=83,cinder:SELECT=42,cinder:INSERT=11,cinder:DELETE=6 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:30:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=61,cinder:UPDATE=77,cinder:DELETE=9,cinder:INSERT=25 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:30:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:30:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:30:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:30:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:30:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:30:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:30:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:30:32 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:30:32 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:30:32 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Feb 26 03:30:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.373s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:30:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:31:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:31:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:31:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:31:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:31:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:31:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:31:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:31:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:31:32 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:31:32 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:31:32 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Feb 26 03:31:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.367s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:31:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:32:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:32:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:32:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:32:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:32:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:32:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:32:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:32:32 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:32:32 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:32:32 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Feb 26 03:32:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.371s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:32:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:33:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:33:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:33:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:33:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:33:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:33:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:33:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:33:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:33:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:33:32 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:33:32 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:33:32 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Feb 26 03:33:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.386s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:33:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:34:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:34:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:34:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:34:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:34:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:34:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:34:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:34:32 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:34:32 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:34:32 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Feb 26 03:34:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.376s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:34:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:35:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:35:05 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:35:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Acquiring lock "cinder-b753f951-31a4-42ad-97c2-e739b693c843-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Lock "cinder-b753f951-31a4-42ad-97c2-e739b693c843-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Acquiring lock "cinder-quobyte-b753f951-31a4-42ad-97c2-e739b693c843" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Lock "cinder-quobyte-b753f951-31a4-42ad-97c2-e739b693c843" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:16 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abdb39d-0c9f-4f31-a174-0859706e0aee]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:16 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843 Feb 26 03:35:16 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:17 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843" returned: 0 in 0.440s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:17 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843 Feb 26 03:35:17 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:17 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b753f951-31a4-42ad-97c2-e739b693c843" returned: 0 in 0.374s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Lock "cinder-quobyte-b753f951-31a4-42ad-97c2-e739b693c843" released by "delete_volume" :: held 0.844s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Created reservations ['d9702003-4fe6-40c0-8a91-f0074df21881', 'fde0f8df-8344-4fbe-8560-51e8d81ec104', '441199b1-bb20-4105-b586-832884525649', '70cedf41-822b-4811-a00a-f3998921b7e8'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:17 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:35:17 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:17 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.392s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:17 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:35:17 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Deleted volume successfully. Feb 26 03:35:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a356fe5b-c52b-4592-8b82-066884e624d9 tempest-VolumesNegativeTest-218564941 None] Lock "cinder-b753f951-31a4-42ad-97c2-e739b693c843-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Flow 'volume_create_manager' (f1ec46d4-9b84-4746-b37d-b69e5bca61ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1f9707-a6a1-4b70-93ca-afec76739667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1f9707-a6a1-4b70-93ca-afec76739667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-129267025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf4707a1ed494c40925c190f5e70210c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:35:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:35:19Z,use_quota=True,user_id='d93af284ba854aafb8137261a05a0ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56390aa4-888f-4de5-a380-666cd948f6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56390aa4-888f-4de5-a380-666cd948f6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dae50b-d9ed-4177-9e63-5f0833e02c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dae50b-d9ed-4177-9e63-5f0833e02c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf', 'volume_name': 'volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf', 'volume_size': 2}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a81ae22-675d-440d-9f36-737375f5355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a81ae22-675d-440d-9f36-737375f5355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0009f457-9068-42dc-a037-2185a86f4a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:19 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Volume 7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf', 'volume_size': 2} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-129267025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf4707a1ed494c40925c190f5e70210c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:35:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:35:19Z,use_quota=True,user_id='d93af284ba854aafb8137261a05a0ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Creating volume 7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:35:19 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf 2147483648 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:19 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf 2147483648 Feb 26 03:35:19 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:19 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf 2147483648" returned: 0 in 0.440s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:19 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf Feb 26 03:35:19 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:20 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" returned: 0 in 0.373s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0009f457-9068-42dc-a037-2185a86f4a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf', 'volume_size': 2}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17f4b35-8ed0-4e93-99cc-8834f5225ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:20 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Volume volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf (7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf): created successfully Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17f4b35-8ed0-4e93-99cc-8834f5225ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Flow 'volume_create_manager' (f1ec46d4-9b84-4746-b37d-b69e5bca61ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:35:20 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3dd35011-c823-494c-b842-3881368e1c58 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Created volume successfully. Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Creating offline snapshot d963d9aa-17a4-4127-8066-c7013e0dd9e0 of volume 7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06c49ed-1c27-4ef7-af19-97adb8e5e56c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:20 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf Feb 26 03:35:20 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:20 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" returned: 0 in 0.437s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 2G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:20 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 2G Feb 26 03:35:20 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:21 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 2G" returned: 0 in 0.419s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:21 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 Feb 26 03:35:21 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:21 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0" returned: 0 in 0.393s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:21 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 is being set with open permissions: ugo+rw Feb 26 03:35:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:21 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 Feb 26 03:35:21 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:21 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0" returned: 0 in 0.373s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:21 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.info Feb 26 03:35:21 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:22 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.info" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:22 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.info is being set with open permissions: ugo+rw Feb 26 03:35:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:22 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.info Feb 26 03:35:22 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:22 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.info" returned: 0 in 0.364s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:22 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e95b49f0-7d87-469e-b28b-b2575b7ced33 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Create snapshot completed successfully Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Acquiring lock "cinder-d963d9aa-17a4-4127-8066-c7013e0dd9e0-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "cinder-d963d9aa-17a4-4127-8066-c7013e0dd9e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Acquiring lock "cinder-quobyte-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "cinder-quobyte-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Acquiring lock "cinder-quobyte-d963d9aa-17a4-4127-8066-c7013e0dd9e0" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "cinder-quobyte-d963d9aa-17a4-4127-8066-c7013e0dd9e0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Deleting offline snapshot d963d9aa-17a4-4127-8066-c7013e0dd9e0 of volume 7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] snapshot_file for this snap is: volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0414108a-d46a-4bbe-9993-774eb7cc1a20]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:23 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 Feb 26 03:35:23 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:23 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0" returned: 0 in 0.435s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb93055-492f-433e-bdc5-af924528fc99]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:24 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf Feb 26 03:35:24 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:24 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" returned: 0 in 0.431s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:24 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 Feb 26 03:35:24 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:24 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0" returned: 0 in 0.400s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:24 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0 Feb 26 03:35:24 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:25 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf.d963d9aa-17a4-4127-8066-c7013e0dd9e0" returned: 0 in 0.379s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "cinder-quobyte-d963d9aa-17a4-4127-8066-c7013e0dd9e0" released by "_delete_snapshot" :: held 1.693s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "cinder-quobyte-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" released by "delete_snapshot" :: held 1.704s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Created reservations ['027de1da-789e-4abd-8171-887426da4858', '487d592d-97f4-407b-8bf6-3d5c7371d880', '925f24ac-7172-49a4-8e7b-59f185ca065d', '6548c181-9c90-4b93-bc22-eeae330deea9'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:35:25 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Delete snapshot completed successfully. Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-96b618f9-93b1-401b-95e7-a3ec946b6f09 tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "cinder-d963d9aa-17a4-4127-8066-c7013e0dd9e0-delete_snapshot" released by "delete_snapshot" :: held 1.778s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Acquiring lock "cinder-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "cinder-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Acquiring lock "cinder-quobyte-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "cinder-quobyte-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c116d5-53ae-485f-9a9f-6511d446ff42]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:25 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf Feb 26 03:35:25 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:26 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" returned: 0 in 0.433s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:26 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf Feb 26 03:35:26 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:26 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" returned: 0 in 0.366s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "cinder-quobyte-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf" released by "delete_volume" :: held 0.824s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Created reservations ['354f0270-821a-47ac-b0b8-7ed47beed0b5', '2fa73615-2f5a-4ed0-b423-e5d3aa85fc6f', '60d7d050-27b9-413d-9b1f-3a2a0d131de6', '0cf35659-542c-4172-8b27-c2a062a344e7'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:26 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:35:26 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:26 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.436s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:26 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:35:27 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Deleted volume successfully. Feb 26 03:35:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-71c39367-bb0c-42d4-92b3-9028dacb0a8e tempest-VolumesSnapshotNegativeTestJSON-1170299539 None] Lock "cinder-7eb4e010-ab3b-42fc-8a4d-c9a530eb67bf-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:35:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:35:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:35:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:32 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:35:32 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:32 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.437s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:35:36 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=21,cinder:SELECT=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:35:37 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=21,cinder:INSERT=9,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:35:38 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Flow 'volume_create_manager' (5baddae2-7408-4e6e-a212-3b853e25fd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a04d9b-d184-4184-a071-fe034f281c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a04d9b-d184-4184-a071-fe034f281c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1043993070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407ca99a-5442-4557-b567-6a2d95878fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf9a06004b64d7c985346fc23addc20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:35:39Z,use_quota=True,user_id='c5a8c9ec971143fab79dba74dd2d46c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53c22ce-d386-4c6c-9a13-2d56dbaaefc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53c22ce-d386-4c6c-9a13-2d56dbaaefc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42e8354-a773-46b7-ba17-c089c53f5d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42e8354-a773-46b7-ba17-c089c53f5d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407ca99a-5442-4557-b567-6a2d95878fb0', 'volume_name': 'volume-407ca99a-5442-4557-b567-6a2d95878fb0', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21387e65-68a5-44f4-b1fc-0f7e1a386f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21387e65-68a5-44f4-b1fc-0f7e1a386f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571a4c25-401f-4119-bf45-979102d55c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:39 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Volume 407ca99a-5442-4557-b567-6a2d95878fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407ca99a-5442-4557-b567-6a2d95878fb0', 'volume_size': 1} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1043993070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407ca99a-5442-4557-b567-6a2d95878fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf9a06004b64d7c985346fc23addc20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:35:39Z,use_quota=True,user_id='c5a8c9ec971143fab79dba74dd2d46c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Creating volume 407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:35:39 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:39 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 1073741824 Feb 26 03:35:39 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:39 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 1073741824" returned: 0 in 0.455s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:39 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 Feb 26 03:35:39 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:39 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0" returned: 0 in 0.365s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571a4c25-401f-4119-bf45-979102d55c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407ca99a-5442-4557-b567-6a2d95878fb0', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4456b01d-4cf9-41d0-a3f8-200825ce8059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:39 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Volume volume-407ca99a-5442-4557-b567-6a2d95878fb0 (407ca99a-5442-4557-b567-6a2d95878fb0): created successfully Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4456b01d-4cf9-41d0-a3f8-200825ce8059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Flow 'volume_create_manager' (5baddae2-7408-4e6e-a212-3b853e25fd49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:35:39 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0a128006-88d3-4334-9a19-2d731306d65c tempest-SnapshotDependencyTests-1269191819 None] Created volume successfully. Feb 26 03:35:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Creating offline snapshot 6c298233-2abf-4621-9429-9a2ae9c9149e of volume 407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:35:40 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff5ee38-277f-4a1d-9cc0-541ae95d84a4]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:40 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 Feb 26 03:35:40 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:40 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0" returned: 0 in 0.439s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:40 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e 1G Feb 26 03:35:40 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:41 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e 1G" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407ca99a-5442-4557-b567-6a2d95878fb0 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:41 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407ca99a-5442-4557-b567-6a2d95878fb0 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e Feb 26 03:35:41 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:41 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407ca99a-5442-4557-b567-6a2d95878fb0 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:41 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e is being set with open permissions: ugo+rw Feb 26 03:35:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:41 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e Feb 26 03:35:41 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:41 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e" returned: 0 in 0.364s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:41 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.info Feb 26 03:35:41 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:42 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.info" returned: 0 in 0.408s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:42 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.info is being set with open permissions: ugo+rw Feb 26 03:35:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:42 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.info Feb 26 03:35:42 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:42 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.info" returned: 0 in 0.363s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.456s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:42 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-7abfdf90-a1a4-4565-a69c-5e21bfe77f12 tempest-SnapshotDependencyTests-1269191819 None] Create snapshot completed successfully Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Flow 'volume_create_manager' (09903574-f75e-473f-a53f-8a8939084280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01ed13a-30b8-45d7-8e56-e79f46c1205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01ed13a-30b8-45d7-8e56-e79f46c1205d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408ca7e1-3e4a-4db1-ba5e-50b7277a25b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf9a06004b64d7c985346fc23addc20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6c298233-2abf-4621-9429-9a2ae9c9149e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:35:44Z,use_quota=True,user_id='c5a8c9ec971143fab79dba74dd2d46c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b871afe8-8983-49f2-bbbc-6ff013f610a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b871afe8-8983-49f2-bbbc-6ff013f610a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c709b4-02c7-4d37-a35c-7e2d6e7929e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c709b4-02c7-4d37-a35c-7e2d6e7929e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '408ca7e1-3e4a-4db1-ba5e-50b7277a25b8', 'volume_name': 'volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8', 'volume_size': 1, 'snapshot_id': '6c298233-2abf-4621-9429-9a2ae9c9149e'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37646c95-3b82-4fc9-ba21-8741e441d188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37646c95-3b82-4fc9-ba21-8741e441d188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af6ee99-e356-49ae-ac4f-2377d44345cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:43 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Volume 408ca7e1-3e4a-4db1-ba5e-50b7277a25b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8', 'volume_size': 1, 'snapshot_id': '6c298233-2abf-4621-9429-9a2ae9c9149e'} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "cinder-quobyte-6c298233-2abf-4621-9429-9a2ae9c9149e-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" by "_create_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-6c298233-2abf-4621-9429-9a2ae9c9149e-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Creating volume 408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 from snapshot 6c298233-2abf-4621-9429-9a2ae9c9149e {{(pid=83121) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "cinder-quobyte-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] snapshot: 6c298233-2abf-4621-9429-9a2ae9c9149e, volume: 408ca7e1-3e4a-4db1-ba5e-50b7277a25b8, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2659f9c-804b-4af7-8583-4298191fe06a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:43 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e Feb 26 03:35:43 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:44 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e" returned: 0 in 0.493s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-407ca99a-5442-4557-b567-6a2d95878fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:35:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:35:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:35:44 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e56089e-bb54-498d-827e-d2ab398bcabe]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:44 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 Feb 26 03:35:44 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:44 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:44 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:35:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:44 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 Feb 26 03:35:44 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:46 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" returned: 0 in 1.789s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:46 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acc10ee-fc64-4b12-a65b-0017e95fe4b3]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:46 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 Feb 26 03:35:46 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:46 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0" returned: 0 in 0.554s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:46 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0, size 1024.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:35:46 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Converted 1024.00 MB image at 571.91 MB/s Feb 26 03:35:46 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 is being set with open permissions: ugo+rw Feb 26 03:35:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:47 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 Feb 26 03:35:47 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:47 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" returned: 0 in 0.367s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" released by "_copy_volume_from_snapshot" :: held 3.694s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-6c298233-2abf-4621-9429-9a2ae9c9149e-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" released by "_create_volume_from_snapshot" :: held 3.707s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.715s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af6ee99-e356-49ae-ac4f-2377d44345cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8', 'volume_size': 1, 'snapshot_id': '6c298233-2abf-4621-9429-9a2ae9c9149e'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad6fe3b-4054-46cb-a6b5-fbf2d5e66de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:35:47 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Volume volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 (408ca7e1-3e4a-4db1-ba5e-50b7277a25b8): created successfully Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad6fe3b-4054-46cb-a6b5-fbf2d5e66de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Flow 'volume_create_manager' (09903574-f75e-473f-a53f-8a8939084280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:35:47 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-41bb7e0f-3b53-4a70-a3c3-109bf3d6e75c tempest-SnapshotDependencyTests-1269191819 None] Created volume successfully. Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "cinder-6c298233-2abf-4621-9429-9a2ae9c9149e-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-6c298233-2abf-4621-9429-9a2ae9c9149e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "cinder-quobyte-407ca99a-5442-4557-b567-6a2d95878fb0" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-407ca99a-5442-4557-b567-6a2d95878fb0" acquired by "delete_snapshot" :: waited 0.005s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "cinder-quobyte-6c298233-2abf-4621-9429-9a2ae9c9149e" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-6c298233-2abf-4621-9429-9a2ae9c9149e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Deleting offline snapshot 6c298233-2abf-4621-9429-9a2ae9c9149e of volume 407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] snapshot_file for this snap is: volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a018d106-a5a5-47e8-b133-2508d9c60958]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:47 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e Feb 26 03:35:47 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:48 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e" returned: 0 in 0.438s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:48 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-407ca99a-5442-4557-b567-6a2d95878fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:35:48 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[85829c4b-aef5-4bcc-818d-16e14be520b8]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:48 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 Feb 26 03:35:48 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:48 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0" returned: 0 in 0.438s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:48 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e Feb 26 03:35:48 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:49 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e" returned: 0 in 0.489s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:49 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e Feb 26 03:35:49 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:49 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0.6c298233-2abf-4621-9429-9a2ae9c9149e" returned: 0 in 0.373s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-6c298233-2abf-4621-9429-9a2ae9c9149e" released by "_delete_snapshot" :: held 1.785s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-407ca99a-5442-4557-b567-6a2d95878fb0" released by "delete_snapshot" :: held 1.794s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:49 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Created reservations ['0b91809e-0a43-4066-b8a4-63a4e6ac3bcf', 'd1d595eb-93ec-4a1d-810a-7210a52da82a', '07d5bcc8-3e7e-4c5e-9b95-c7e483485afc', 'ee7d0e22-446e-40c2-900d-5bff9a87c329'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:35:49 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Delete snapshot completed successfully. Feb 26 03:35:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-bc8ba571-721c-4632-8d6b-48e697f05174 tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-6c298233-2abf-4621-9429-9a2ae9c9149e-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "cinder-407ca99a-5442-4557-b567-6a2d95878fb0-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-407ca99a-5442-4557-b567-6a2d95878fb0-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "cinder-quobyte-407ca99a-5442-4557-b567-6a2d95878fb0" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-407ca99a-5442-4557-b567-6a2d95878fb0" acquired by "delete_volume" :: waited 0.005s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[036b3719-53e4-4dff-9bc3-ccb8e575a3cb]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:50 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 Feb 26 03:35:50 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:50 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0" returned: 0 in 0.427s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:50 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0 Feb 26 03:35:50 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:50 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-407ca99a-5442-4557-b567-6a2d95878fb0" returned: 0 in 0.374s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-407ca99a-5442-4557-b567-6a2d95878fb0" released by "delete_volume" :: held 0.832s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Created reservations ['2f0c8e05-71a1-4489-aa2a-f70c64ce5b4c', '44107e7a-b0f6-4a3a-bd53-b61906fcba87', '3b65ede6-2f2b-4d25-9d0e-48c7b0222936', '26971e51-46d7-49cd-9698-f4fdd2dcf3ff'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:50 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:35:50 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "cinder-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "cinder-quobyte-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" acquired by "delete_volume" :: waited 0.018s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19bbc73-fbf3-479c-98ed-903210cdd104]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:51 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 Feb 26 03:35:51 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:51 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.394s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:35:51 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Deleted volume successfully. Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2e3f8d75-469b-4502-a24d-a3f30f262da0 tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-407ca99a-5442-4557-b567-6a2d95878fb0-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:51 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:51 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8 Feb 26 03:35:51 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:51 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" returned: 0 in 0.371s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-quobyte-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8" released by "delete_volume" :: held 0.823s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:35:52 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Created reservations ['1b373fc1-feb3-4cf2-9844-0e8444689844', 'c39fac7b-94ac-4b62-bd0c-f91d70432d8e', '7e1f79c1-6477-4ada-a485-40fa6856119b', '69821e40-ef3a-476f-bac8-c9302ca377de'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:35:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:35:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:35:52 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:35:52 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:35:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:35:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:35:52 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:35:52 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:35:52 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Feb 26 03:35:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.382s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:35:52 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:35:52 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Deleted volume successfully. Feb 26 03:35:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9aeadca4-2e6c-4a29-a149-909b72a3901c tempest-SnapshotDependencyTests-1269191819 None] Lock "cinder-408ca7e1-3e4a-4db1-ba5e-50b7277a25b8-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:02 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=34,cinder:SELECT=25,cinder:INSERT=9,cinder:DELETE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:36:02 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:DELETE=4,cinder:INSERT=5 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Flow 'volume_create_manager' (85b91f20-0001-4f1c-89dd-3b017451decf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98fca6a-6f67-481a-8e92-d331550ac400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98fca6a-6f67-481a-8e92-d331550ac400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-543705682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb054ad-991b-4b37-bfb3-d708d56b7eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1234f8f1e4a344968e3cd3dd449e3405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:04Z,use_quota=True,user_id='0f3a7f02d5794d04874b6f51ea0493ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b379f9-b6be-4874-8e05-cc22ff361e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b379f9-b6be-4874-8e05-cc22ff361e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1dc15a1-6d65-488c-a71a-1a1c0550699f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1dc15a1-6d65-488c-a71a-1a1c0550699f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb054ad-991b-4b37-bfb3-d708d56b7eed', 'volume_name': 'volume-adb054ad-991b-4b37-bfb3-d708d56b7eed', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ce4e45-f178-4ad2-8288-8efdb31fd649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ce4e45-f178-4ad2-8288-8efdb31fd649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b7498c-20e7-4a46-907c-314b97511b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Volume adb054ad-991b-4b37-bfb3-d708d56b7eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb054ad-991b-4b37-bfb3-d708d56b7eed', 'volume_size': 1} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-543705682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb054ad-991b-4b37-bfb3-d708d56b7eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1234f8f1e4a344968e3cd3dd449e3405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:04Z,use_quota=True,user_id='0f3a7f02d5794d04874b6f51ea0493ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Creating volume adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:04 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Flow 'volume_create_manager' (ba7c2859-761b-4952-b506-aed72a3790f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:04 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed 1073741824 Feb 26 03:36:04 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfe4136-7435-48dc-84db-2d8f688884a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfe4136-7435-48dc-84db-2d8f688884a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-219989564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5d8d829824f1f8abad842595db82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:04Z,use_quota=True,user_id='7109ffd1113244a7892d2f5dcee92ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97135ef-d629-4df2-b6a7-c5794875f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97135ef-d629-4df2-b6a7-c5794875f80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c4288d-566f-4500-8bd3-47131aa5d9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c4288d-566f-4500-8bd3-47131aa5d9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5', 'volume_name': 'volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649e6176-7d4e-48b0-ba66-2bedce21cae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649e6176-7d4e-48b0-ba66-2bedce21cae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbcc372-cc1e-4eea-86ab-882df2e2dbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Volume f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5', 'volume_size': 1} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Flow 'volume_create_manager' (d82659dd-0ad5-47ef-a48d-e6a0263c230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b808dfe4-9cde-4587-953a-06c38bfe3d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b808dfe4-9cde-4587-953a-06c38bfe3d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492304302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd43c66e-3431-4482-8964-6193af75337b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5d8d829824f1f8abad842595db82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:05Z,use_quota=True,user_id='7109ffd1113244a7892d2f5dcee92ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2d6a91-b520-438f-a315-36cec725cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2d6a91-b520-438f-a315-36cec725cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c738662a-a5cc-4266-84fc-cc959abdc5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c738662a-a5cc-4266-84fc-cc959abdc5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd43c66e-3431-4482-8964-6193af75337b', 'volume_name': 'volume-dd43c66e-3431-4482-8964-6193af75337b', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325e54b7-cd18-45bb-8924-3240615b3769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325e54b7-cd18-45bb-8924-3240615b3769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0effb46-75d2-4782-ae00-ecda11f22e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:04 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Volume dd43c66e-3431-4482-8964-6193af75337b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd43c66e-3431-4482-8964-6193af75337b', 'volume_size': 1} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (3a6ae9a5-2182-4027-939f-286ddd2d41cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:04 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15848954-02b7-4405-91dc-0e40007d1983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15848954-02b7-4405-91dc-0e40007d1983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1784262154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e308ff1d-15fb-4ce5-9fe2-e87176dbb1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:05Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e748e694-d1a4-4d39-9e8b-1f5aaddd7b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e748e694-d1a4-4d39-9e8b-1f5aaddd7b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9920dc-329e-41fe-b69d-9be8069f71f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9920dc-329e-41fe-b69d-9be8069f71f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e308ff1d-15fb-4ce5-9fe2-e87176dbb1be', 'volume_name': 'volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade63902-6245-4eab-8ecf-133c66f1ff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade63902-6245-4eab-8ecf-133c66f1ff00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38c7cbf-d6ab-427f-8697-14704597b4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume e308ff1d-15fb-4ce5-9fe2-e87176dbb1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be', 'volume_size': 1} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Flow 'volume_create_manager' (7ad06d16-62fe-4603-a8d2-7e5f616c6416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c074ab-3206-43ee-b9e8-a5ac6ad6445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c074ab-3206-43ee-b9e8-a5ac6ad6445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989245796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7700f631-546c-4a32-b598-00e4e5baa9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5d8d829824f1f8abad842595db82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:05Z,use_quota=True,user_id='7109ffd1113244a7892d2f5dcee92ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae03620-3597-4e24-9034-d6e91e4d2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae03620-3597-4e24-9034-d6e91e4d2a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173dcb7a-ca00-4e63-8aee-a0d8329994d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173dcb7a-ca00-4e63-8aee-a0d8329994d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7700f631-546c-4a32-b598-00e4e5baa9e6', 'volume_name': 'volume-7700f631-546c-4a32-b598-00e4e5baa9e6', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076b5dfc-3830-41c1-8b1b-973cf4cd6ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076b5dfc-3830-41c1-8b1b-973cf4cd6ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec229ea3-af44-48a7-8833-0eaca5a5e72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Volume 7700f631-546c-4a32-b598-00e4e5baa9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7700f631-546c-4a32-b598-00e4e5baa9e6', 'volume_size': 1} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Flow 'volume_create_manager' (219c22cf-6a1a-425f-83b2-e7bfc928ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953c0e74-8743-4e7e-a513-b093d0fbfaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953c0e74-8743-4e7e-a513-b093d0fbfaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1484389932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41af281f-225c-49e6-a5bb-e7e5d1832fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5d8d829824f1f8abad842595db82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:05Z,use_quota=True,user_id='7109ffd1113244a7892d2f5dcee92ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce759114-1dce-4cda-935f-543a8166f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce759114-1dce-4cda-935f-543a8166f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12db32ca-170b-46f3-b515-25e2b587f56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12db32ca-170b-46f3-b515-25e2b587f56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41af281f-225c-49e6-a5bb-e7e5d1832fd7', 'volume_name': 'volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33966e9-5722-4723-ba3e-e79cea10b6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33966e9-5722-4723-ba3e-e79cea10b6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3d4a5c-699b-4e3a-85a8-edf7b70608e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Volume 41af281f-225c-49e6-a5bb-e7e5d1832fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7', 'volume_size': 1} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed 1073741824" returned: 0 in 0.720s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:05 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed Feb 26 03:36:05 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Flow 'volume_create_manager' (ca4adfa7-5fcd-4624-819a-d4006bc2fb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65efd1a8-761b-4ae0-917f-634308049921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65efd1a8-761b-4ae0-917f-634308049921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1477230720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9146d2dc-6dd6-470c-a91f-83bc0b074c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5d8d829824f1f8abad842595db82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:05Z,use_quota=True,user_id='7109ffd1113244a7892d2f5dcee92ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309b1669-2cea-4b59-a654-188de9d6466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309b1669-2cea-4b59-a654-188de9d6466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de55fd49-ee0d-4486-9a0e-91078b987829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de55fd49-ee0d-4486-9a0e-91078b987829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9146d2dc-6dd6-470c-a91f-83bc0b074c09', 'volume_name': 'volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365d58ef-86aa-4cd2-a70b-c95ccfcec240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365d58ef-86aa-4cd2-a70b-c95ccfcec240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15921b9e-d7d8-4305-bf3d-31b06ed557ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Volume 9146d2dc-6dd6-470c-a91f-83bc0b074c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09', 'volume_size': 1} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:05 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed" returned: 0 in 0.481s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.076s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-219989564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5d8d829824f1f8abad842595db82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:04Z,use_quota=True,user_id='7109ffd1113244a7892d2f5dcee92ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Creating volume f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:05 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b7498c-20e7-4a46-907c-314b97511b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb054ad-991b-4b37-bfb3-d708d56b7eed', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061b31f7-93c8-406d-81a4-83c3a8e5df7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:05 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 1073741824 Feb 26 03:36:05 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:05 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Volume volume-adb054ad-991b-4b37-bfb3-d708d56b7eed (adb054ad-991b-4b37-bfb3-d708d56b7eed): created successfully Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061b31f7-93c8-406d-81a4-83c3a8e5df7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:05 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Flow 'volume_create_manager' (85b91f20-0001-4f1c-89dd-3b017451decf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:05 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-7fea4fb9-281c-44b9-8fcf-3a70e13d34b5 tempest-VolumeDependencyTests-1909018923 None] Created volume successfully. Feb 26 03:36:06 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 1073741824" returned: 0 in 0.499s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:06 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 Feb 26 03:36:06 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:06 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5" returned: 0 in 0.492s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.863s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492304302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd43c66e-3431-4482-8964-6193af75337b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5d8d829824f1f8abad842595db82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:05Z,use_quota=True,user_id='7109ffd1113244a7892d2f5dcee92ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Creating volume dd43c66e-3431-4482-8964-6193af75337b {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:06 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:06 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b 1073741824 Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbcc372-cc1e-4eea-86ab-882df2e2dbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:06 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8395b4d-128e-4740-94bb-5002b133f461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:06 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Volume volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 (f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5): created successfully Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8395b4d-128e-4740-94bb-5002b133f461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:06 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Flow 'volume_create_manager' (ba7c2859-761b-4952-b506-aed72a3790f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:06 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-05d220d7-1ec4-4de3-b247-e24e953ac21d tempest-CreateVolumesFromImageTest-89603077 None] Created volume successfully. Feb 26 03:36:07 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b 1073741824" returned: 0 in 0.474s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:07 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b Feb 26 03:36:07 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:07 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b" returned: 0 in 0.420s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.691s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1784262154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e308ff1d-15fb-4ce5-9fe2-e87176dbb1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:05Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Creating volume e308ff1d-15fb-4ce5-9fe2-e87176dbb1be {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:07 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0effb46-75d2-4782-ae00-ecda11f22e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd43c66e-3431-4482-8964-6193af75337b', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:07 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be 1073741824 Feb 26 03:36:07 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fc21f7-6ef9-4b8d-b0c9-cdaf52c617a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:07 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Volume volume-dd43c66e-3431-4482-8964-6193af75337b (dd43c66e-3431-4482-8964-6193af75337b): created successfully Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fc21f7-6ef9-4b8d-b0c9-cdaf52c617a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:07 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Flow 'volume_create_manager' (d82659dd-0ad5-47ef-a48d-e6a0263c230f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:07 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2570806c-28b4-4182-8245-d634720970fd tempest-CreateVolumesFromImageTest-89603077 None] Created volume successfully. Feb 26 03:36:08 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be 1073741824" returned: 0 in 0.490s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:08 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be Feb 26 03:36:08 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:08 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" returned: 0 in 0.474s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.573s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989245796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7700f631-546c-4a32-b598-00e4e5baa9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5d8d829824f1f8abad842595db82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:05Z,use_quota=True,user_id='7109ffd1113244a7892d2f5dcee92ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Creating volume 7700f631-546c-4a32-b598-00e4e5baa9e6 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:08 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38c7cbf-d6ab-427f-8697-14704597b4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:08 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6 1073741824 Feb 26 03:36:08 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e480331-9809-4fa5-9fc4-0fffd0ad2f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:08 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be (e308ff1d-15fb-4ce5-9fe2-e87176dbb1be): created successfully Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e480331-9809-4fa5-9fc4-0fffd0ad2f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:08 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (3a6ae9a5-2182-4027-939f-286ddd2d41cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:08 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3b51ee2b-6509-4376-a5ab-cff3fadc2910 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created volume successfully. Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:09 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6 1073741824" returned: 0 in 0.540s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:09 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6 Feb 26 03:36:09 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:09 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6" returned: 0 in 0.397s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.424s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1484389932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41af281f-225c-49e6-a5bb-e7e5d1832fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5d8d829824f1f8abad842595db82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:05Z,use_quota=True,user_id='7109ffd1113244a7892d2f5dcee92ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Creating volume 41af281f-225c-49e6-a5bb-e7e5d1832fd7 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:09 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec229ea3-af44-48a7-8833-0eaca5a5e72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7700f631-546c-4a32-b598-00e4e5baa9e6', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b007b81d-fee0-410f-86ce-70cb0df27a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:09 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7 1073741824 Feb 26 03:36:09 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:09 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Volume volume-7700f631-546c-4a32-b598-00e4e5baa9e6 (7700f631-546c-4a32-b598-00e4e5baa9e6): created successfully Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b007b81d-fee0-410f-86ce-70cb0df27a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:09 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Flow 'volume_create_manager' (7ad06d16-62fe-4603-a8d2-7e5f616c6416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:09 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-ad2d890e-6f32-4348-9501-ef83b6d3787f tempest-CreateVolumesFromImageTest-89603077 None] Created volume successfully. Feb 26 03:36:10 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7 1073741824" returned: 0 in 0.517s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:10 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7 Feb 26 03:36:10 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:10 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7" returned: 0 in 0.529s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.247s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1477230720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9146d2dc-6dd6-470c-a91f-83bc0b074c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5d8d829824f1f8abad842595db82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:05Z,use_quota=True,user_id='7109ffd1113244a7892d2f5dcee92ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Creating volume 9146d2dc-6dd6-470c-a91f-83bc0b074c09 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:10 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:10 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09 1073741824 Feb 26 03:36:10 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3d4a5c-699b-4e3a-85a8-edf7b70608e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (588cd4d4-a272-4cff-8ea3-89fb6666d860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:10 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Volume volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7 (41af281f-225c-49e6-a5bb-e7e5d1832fd7): created successfully Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (588cd4d4-a272-4cff-8ea3-89fb6666d860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:10 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Flow 'volume_create_manager' (219c22cf-6a1a-425f-83b2-e7bfc928ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:10 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-abbd94c6-1e97-4fe0-9966-1287a3fd1422 tempest-CreateVolumesFromImageTest-89603077 None] Created volume successfully. Feb 26 03:36:11 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09 1073741824" returned: 0 in 0.540s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:11 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09 Feb 26 03:36:11 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:11 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09" returned: 0 in 0.413s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.060s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15921b9e-d7d8-4305-bf3d-31b06ed557ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e42c708-4381-497e-9123-a643086657ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Creating offline snapshot 6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 of volume adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:36:11 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Volume volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09 (9146d2dc-6dd6-470c-a91f-83bc0b074c09): created successfully Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e42c708-4381-497e-9123-a643086657ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Flow 'volume_create_manager' (ca4adfa7-5fcd-4624-819a-d4006bc2fb25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cd91a3-b2dc-4cb0-ab2c-e76eb11fe137]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:11 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:11 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-87910d64-8875-4d93-a7ce-6f7762933f93 tempest-CreateVolumesFromImageTest-89603077 None] Created volume successfully. Feb 26 03:36:11 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed Feb 26 03:36:11 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "cinder-9146d2dc-6dd6-470c-a91f-83bc0b074c09-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-9146d2dc-6dd6-470c-a91f-83bc0b074c09-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "cinder-quobyte-9146d2dc-6dd6-470c-a91f-83bc0b074c09" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-quobyte-9146d2dc-6dd6-470c-a91f-83bc0b074c09" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e978718-9a9c-430e-b1d1-66f876248c16]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:12 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09 Feb 26 03:36:12 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:12 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed" returned: 0 in 0.559s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:12 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 1G Feb 26 03:36:12 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:12 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09" returned: 0 in 0.500s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:12 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09 Feb 26 03:36:12 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:12 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 1G" returned: 0 in 0.464s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:12 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb054ad-991b-4b37-bfb3-d708d56b7eed -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:12 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb054ad-991b-4b37-bfb3-d708d56b7eed -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 Feb 26 03:36:12 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:13 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-9146d2dc-6dd6-470c-a91f-83bc0b074c09" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-quobyte-9146d2dc-6dd6-470c-a91f-83bc0b074c09" released by "delete_volume" :: held 0.981s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Created reservations ['26a5da96-9a92-486c-88dc-7581d9f4dd1a', '433e810c-1464-43a5-ae6a-0ec1a981f15f', '9e018c38-dba0-4472-993a-a10edc6ab22e', '7984fd17-1fcd-4bcf-b08a-0394917ef43c'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:13 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:13 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:13 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb054ad-991b-4b37-bfb3-d708d56b7eed -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1" returned: 0 in 0.497s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:13 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 is being set with open permissions: ugo+rw Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:13 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 Feb 26 03:36:13 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:13 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.446s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:13 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Deleted volume successfully. Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-79023016-7cff-4a8a-a722-86ee3f551dd2 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-9146d2dc-6dd6-470c-a91f-83bc0b074c09-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:13 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1" returned: 0 in 0.511s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:13 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:13 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.info Feb 26 03:36:13 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "cinder-41af281f-225c-49e6-a5bb-e7e5d1832fd7-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-41af281f-225c-49e6-a5bb-e7e5d1832fd7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "cinder-quobyte-41af281f-225c-49e6-a5bb-e7e5d1832fd7" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-quobyte-41af281f-225c-49e6-a5bb-e7e5d1832fd7" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5a7023-1274-4c87-b49f-874dbd2c7920]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:14 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.info" returned: 0 in 0.474s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:14 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.info is being set with open permissions: ugo+rw Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:14 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.info Feb 26 03:36:14 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:14 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7 Feb 26 03:36:14 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:14 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7" returned: 0 in 0.578s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:14 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7 Feb 26 03:36:14 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:14 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.info" returned: 0 in 0.524s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.105s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.768s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Creating offline snapshot fcb08456-652c-453c-a867-ea8d305e4827 of volume e308ff1d-15fb-4ce5-9fe2-e87176dbb1be {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:36:14 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b45b4f54-7b35-434f-8e1b-ef6b49d3ac39 tempest-VolumeDependencyTests-1909018923 None] Create snapshot completed successfully Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf0263a-46e0-441d-997e-f8c2f3047632]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:14 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:15 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be Feb 26 03:36:15 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:15 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-41af281f-225c-49e6-a5bb-e7e5d1832fd7" returned: 0 in 0.623s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-quobyte-41af281f-225c-49e6-a5bb-e7e5d1832fd7" released by "delete_volume" :: held 1.226s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Created reservations ['b571feb5-c621-4755-9b20-47afa2df810b', '2081e409-0bab-474e-85c0-2218cd88b85e', 'c7fc599a-facd-42a6-ab8a-d742d4fdfd24', 'babcea4b-61e6-4c9c-a0f0-9f81cd882628'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:15 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:15 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:15 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" returned: 0 in 0.725s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:15 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 1G Feb 26 03:36:15 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Flow 'volume_create_manager' (9b384f67-fda0-4769-bdeb-1be7582f06b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fa190e-8b7e-411e-85ce-4768b7da9cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fa190e-8b7e-411e-85ce-4768b7da9cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-54956346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28f3999-e52d-43fc-be55-987aff27bc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1234f8f1e4a344968e3cd3dd449e3405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:16Z,use_quota=True,user_id='0f3a7f02d5794d04874b6f51ea0493ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6876f472-a95d-4040-a11f-ecd85fb374f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6876f472-a95d-4040-a11f-ecd85fb374f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5583a3-4710-4436-8019-a3e5b5483259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5583a3-4710-4436-8019-a3e5b5483259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c28f3999-e52d-43fc-be55-987aff27bc3d', 'volume_name': 'volume-c28f3999-e52d-43fc-be55-987aff27bc3d', 'volume_size': 1, 'snapshot_id': '6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d585e4-df34-4333-9769-8e2de6b38531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d585e4-df34-4333-9769-8e2de6b38531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285c37d0-0aeb-4ba3-ad1e-53c346222dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:15 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Volume c28f3999-e52d-43fc-be55-987aff27bc3d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c28f3999-e52d-43fc-be55-987aff27bc3d', 'volume_size': 1, 'snapshot_id': '6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1'} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:15 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.426s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:15 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:16 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Deleted volume successfully. Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-162ecc95-2f2e-4fa6-b147-397fd4f2a2cd tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-41af281f-225c-49e6-a5bb-e7e5d1832fd7-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:16 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 1G" returned: 0 in 0.518s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:16 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 Feb 26 03:36:16 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "cinder-7700f631-546c-4a32-b598-00e4e5baa9e6-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-7700f631-546c-4a32-b598-00e4e5baa9e6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "cinder-quobyte-7700f631-546c-4a32-b598-00e4e5baa9e6" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-quobyte-7700f631-546c-4a32-b598-00e4e5baa9e6" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dbbb69-605e-4f39-bf66-b616e750b55f]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:16 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6 Feb 26 03:36:16 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:16 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827" returned: 0 in 0.609s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:16 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 is being set with open permissions: ugo+rw Feb 26 03:36:16 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:16 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 Feb 26 03:36:16 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:17 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6" returned: 0 in 0.664s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:17 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6 Feb 26 03:36:17 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:17 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827" returned: 0 in 0.510s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:17 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.info Feb 26 03:36:17 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Flow 'volume_create_manager' (bdd2a08a-4bfa-4f16-b97c-b3bf4c9c5725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e964dac5-40c4-4fe9-b011-8a339461493f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e964dac5-40c4-4fe9-b011-8a339461493f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2136264279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1861a7e1-2399-4f1b-9063-d5788d367f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826a6dd3a3404e98879253bd9b721e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:18Z,use_quota=True,user_id='2481e30d1c694793a90f922cc4648f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae581d9-ce92-462f-b0a4-b5ad8ec98e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae581d9-ce92-462f-b0a4-b5ad8ec98e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097f83c1-211b-496b-a6bf-c9a8aeac965f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097f83c1-211b-496b-a6bf-c9a8aeac965f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1861a7e1-2399-4f1b-9063-d5788d367f90', 'volume_name': 'volume-1861a7e1-2399-4f1b-9063-d5788d367f90', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84767094-f4c5-4809-97ad-7dbbee9d439d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84767094-f4c5-4809-97ad-7dbbee9d439d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb4e330-4489-4bd4-b6aa-450dd434ce47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:17 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:17 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Volume 1861a7e1-2399-4f1b-9063-d5788d367f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1861a7e1-2399-4f1b-9063-d5788d367f90', 'volume_size': 1} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7700f631-546c-4a32-b598-00e4e5baa9e6" returned: 0 in 0.530s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-quobyte-7700f631-546c-4a32-b598-00e4e5baa9e6" released by "delete_volume" :: held 1.228s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Created reservations ['c9136b5e-c2ec-4142-b247-44aa75a240d3', 'e7613e55-adc6-4335-b67a-c8ceb7ae58c5', '975e517c-a976-40de-a4ac-0fabd08da8c7', '39806b69-57e0-444c-b3c7-f6b3621b3171'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:17 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.info" returned: 0 in 0.572s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:17 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.info is being set with open permissions: ugo+rw Feb 26 03:36:17 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:17 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:17 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:17 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.info Feb 26 03:36:17 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:18 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.394s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:18 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Deleted volume successfully. Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-35a72c60-4326-41c8-b31e-1f3d86445d47 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-7700f631-546c-4a32-b598-00e4e5baa9e6-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:18 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.info" returned: 0 in 0.435s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.436s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.596s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-quobyte-6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1-c28f3999-e52d-43fc-be55-987aff27bc3d" by "_create_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:18 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-f42011cb-5460-4195-acb3-004652a4ad00 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Create snapshot completed successfully Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1-c28f3999-e52d-43fc-be55-987aff27bc3d" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Creating volume c28f3999-e52d-43fc-be55-987aff27bc3d from snapshot 6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 {{(pid=83121) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-quobyte-c28f3999-e52d-43fc-be55-987aff27bc3d" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-c28f3999-e52d-43fc-be55-987aff27bc3d" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] snapshot: 6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1, volume: c28f3999-e52d-43fc-be55-987aff27bc3d, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3d2284-5df5-40e9-b8be-1d9f02679426]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:18 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 Feb 26 03:36:18 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (2844c4a5-d717-4f0f-ae19-da861149c88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e0255c-6f61-4dd7-9b01-3efe03b42ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e0255c-6f61-4dd7-9b01-3efe03b42ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112319912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:19Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56da9f91-a834-421a-86fa-150ef40a558c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56da9f91-a834-421a-86fa-150ef40a558c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bed64ee-6c75-44c4-9296-b9dd1e11aa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bed64ee-6c75-44c4-9296-b9dd1e11aa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe', 'volume_name': 'volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38150d6a-30e2-4c76-b048-6b67081f9d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38150d6a-30e2-4c76-b048-6b67081f9d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ef8468-2f7e-48f8-b327-ca88912343c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:18 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe', 'volume_size': 1} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "cinder-dd43c66e-3431-4482-8964-6193af75337b-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-dd43c66e-3431-4482-8964-6193af75337b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "cinder-quobyte-dd43c66e-3431-4482-8964-6193af75337b" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-quobyte-dd43c66e-3431-4482-8964-6193af75337b" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c43aca9-c781-4279-b418-8b55b71d5a78]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:18 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1" returned: 0 in 0.506s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb054ad-991b-4b37-bfb3-d708d56b7eed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca2437f-c2cc-4fba-83dc-a9d46b36c7e8]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:18 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b Feb 26 03:36:18 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (052d4a8b-06f8-48ec-8f88-63bcb8c04e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595a6aa9-f180-47c8-a849-29f4e219d636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595a6aa9-f180-47c8-a849-29f4e219d636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1889116993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:19Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e918e-3175-42e2-ab75-924479174f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e918e-3175-42e2-ab75-924479174f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f31430-ae97-4505-ab5f-5c4f606d9d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f31430-ae97-4505-ab5f-5c4f606d9d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec', 'volume_name': 'volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abea5e65-8229-48bf-b49c-859a5e3cf458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abea5e65-8229-48bf-b49c-859a5e3cf458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27bd789-18ec-43ea-bfc6-b44037627cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:18 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume 35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec', 'volume_size': 1} Feb 26 03:36:18 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:18 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed Feb 26 03:36:18 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (e2ee2b00-16ea-4158-8e65-20063eeea0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff93bbb-18ec-4f91-bdcc-46341340a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff93bbb-18ec-4f91-bdcc-46341340a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964946036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c05b95-d695-4b38-a325-1f839e1df9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:19Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cc4231-30f3-4197-b5b1-06fd1eceeffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cc4231-30f3-4197-b5b1-06fd1eceeffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b09ef8-e5bf-4277-b763-f6bf4cd50f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b09ef8-e5bf-4277-b763-f6bf4cd50f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c05b95-d695-4b38-a325-1f839e1df9ea', 'volume_name': 'volume-56c05b95-d695-4b38-a325-1f839e1df9ea', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5feeef6-3c85-4105-88d1-96d8dc069ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5feeef6-3c85-4105-88d1-96d8dc069ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0672846b-df57-4762-8ee0-eb1317898c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume 56c05b95-d695-4b38-a325-1f839e1df9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c05b95-d695-4b38-a325-1f839e1df9ea', 'volume_size': 1} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:19 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (8ca67ec3-1ce6-4ec4-a683-06ac7d51d17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbaa841c-aea1-4f36-aa07-25a1577fae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed" returned: 0 in 0.520s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b" returned: 0 in 0.639s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:19 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d Feb 26 03:36:19 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbaa841c-aea1-4f36-aa07-25a1577fae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1673291574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8962019-07f3-4545-bad9-03f55d06e36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:19Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2702a34-be56-4837-8667-fa9a2a103790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b Feb 26 03:36:19 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2702a34-be56-4837-8667-fa9a2a103790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6cd731-1298-43d1-b6d1-4f307c7ec88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6cd731-1298-43d1-b6d1-4f307c7ec88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8962019-07f3-4545-bad9-03f55d06e36a', 'volume_name': 'volume-f8962019-07f3-4545-bad9-03f55d06e36a', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919bfd4f-94c9-4d5f-ae20-2cf5fb7e06a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919bfd4f-94c9-4d5f-ae20-2cf5fb7e06a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bfc817-ea13-46a5-b52b-7434a991197a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume f8962019-07f3-4545-bad9-03f55d06e36a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8962019-07f3-4545-bad9-03f55d06e36a', 'volume_size': 1} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (6862a6b3-8997-426a-ae40-e4ec22ecc227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9cdf08-a166-413e-a47b-3618cb34d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9cdf08-a166-413e-a47b-3618cb34d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-613515883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b35498-a3aa-44f7-b17c-5a2d0191f537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:20Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7735767-1887-4448-9ff0-68f139e319c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7735767-1887-4448-9ff0-68f139e319c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2125b59-f514-408b-b71d-fbf26a4d57bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2125b59-f514-408b-b71d-fbf26a4d57bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b35498-a3aa-44f7-b17c-5a2d0191f537', 'volume_name': 'volume-95b35498-a3aa-44f7-b17c-5a2d0191f537', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f16a98-b3df-48ee-85aa-b1489ecf2b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f16a98-b3df-48ee-85aa-b1489ecf2b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1688a842-c17f-4544-83c5-d43247dbfedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:19 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume 95b35498-a3aa-44f7-b17c-5a2d0191f537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b35498-a3aa-44f7-b17c-5a2d0191f537', 'volume_size': 1} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:19 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd43c66e-3431-4482-8964-6193af75337b" returned: 0 in 0.514s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:19 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-quobyte-dd43c66e-3431-4482-8964-6193af75337b" released by "delete_volume" :: held 1.181s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:20 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Created reservations ['22bd007f-9f4b-4802-8896-71650cf14bc1', '95344565-e744-41d7-b0d1-1e7d4c21a2a1', '3aea37e3-ce93-4ad2-b8a3-ab8302b2df97', '4f978c87-6be1-41b2-9e86-1a11ac9ca231'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:20 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:20 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:20 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:20 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "cinder-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "cinder-quobyte-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-quobyte-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5" acquired by "delete_volume" :: waited 0.036s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee5899f-c9ff-48b3-9416-da228cb709c4]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:21 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 1.321s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:21 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Deleted volume successfully. Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-14a79d93-1bae-408f-9cae-a0d3acfdfe00 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-dd43c66e-3431-4482-8964-6193af75337b-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:21 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 Feb 26 03:36:21 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:21 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d" returned: 0 in 2.175s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e734e3-4856-40fe-8e0a-3808fbc5bec2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:21 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed Feb 26 03:36:21 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:21 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5" returned: 0 in 0.738s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:21 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:21 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5 Feb 26 03:36:21 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:22 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed" returned: 0 in 0.586s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:36:22 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Converted 1024.00 MB image at 469.92 MB/s Feb 26 03:36:22 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d is being set with open permissions: ugo+rw Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:22 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d Feb 26 03:36:22 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:22 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-quobyte-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5" released by "delete_volume" :: held 1.228s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Created reservations ['a388f30a-28ae-40a0-b6ac-aadcdce87ef3', 'f193b99f-6a57-48de-8704-a050638ee96b', '5cbfdd66-3d2c-42c8-91bf-f9a279ae4b9c', '67b3e3e0-97aa-488b-b74d-680c7e0925b7'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:22 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:22 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:22 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d" returned: 0 in 0.429s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-c28f3999-e52d-43fc-be55-987aff27bc3d" released by "_copy_volume_from_snapshot" :: held 4.276s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1-c28f3999-e52d-43fc-be55-987aff27bc3d" released by "_create_volume_from_snapshot" :: held 4.291s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.309s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.863s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2136264279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1861a7e1-2399-4f1b-9063-d5788d367f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826a6dd3a3404e98879253bd9b721e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:18Z,use_quota=True,user_id='2481e30d1c694793a90f922cc4648f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Creating volume 1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:22 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:22 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 1073741824 Feb 26 03:36:22 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285c37d0-0aeb-4ba3-ad1e-53c346222dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c28f3999-e52d-43fc-be55-987aff27bc3d', 'volume_size': 1, 'snapshot_id': '6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd89770-35ee-4c31-a728-d45c95e4f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:22 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Volume volume-c28f3999-e52d-43fc-be55-987aff27bc3d (c28f3999-e52d-43fc-be55-987aff27bc3d): created successfully Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd89770-35ee-4c31-a728-d45c95e4f335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Flow 'volume_create_manager' (9b384f67-fda0-4769-bdeb-1be7582f06b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:22 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e5636885-3786-4712-8802-412cb18d1b3d tempest-VolumeDependencyTests-1909018923 None] Created volume successfully. Feb 26 03:36:22 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.392s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:22 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Deleted volume successfully. Feb 26 03:36:22 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-5bbfda61-9cb5-4baa-85c9-5386434b8ae3 tempest-CreateVolumesFromImageTest-89603077 None] Lock "cinder-f7f16dcc-3c3e-4edf-bddf-0b4d3d3269c5-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-quobyte-adb054ad-991b-4b37-bfb3-d708d56b7eed" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:23 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 1073741824" returned: 0 in 0.521s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-adb054ad-991b-4b37-bfb3-d708d56b7eed" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-quobyte-6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Deleting offline snapshot 6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 of volume adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] snapshot_file for this snap is: volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[342f6365-994a-4665-9da8-aa0100b47a13]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:23 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 Feb 26 03:36:23 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:23 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 Feb 26 03:36:23 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:23 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90" returned: 0 in 0.480s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.983s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112319912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:19Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Creating volume dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:23 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:23 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe 1073741824 Feb 26 03:36:23 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb4e330-4489-4bd4-b6aa-450dd434ce47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1861a7e1-2399-4f1b-9063-d5788d367f90', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2ff9c2-6845-4364-a887-7d10f9762fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:23 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Volume volume-1861a7e1-2399-4f1b-9063-d5788d367f90 (1861a7e1-2399-4f1b-9063-d5788d367f90): created successfully Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2ff9c2-6845-4364-a887-7d10f9762fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Flow 'volume_create_manager' (bdd2a08a-4bfa-4f16-b97c-b3bf4c9c5725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:23 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-70a1f5ef-fa5a-41e0-a20a-e3aa6501f929 tempest-SnapshotDependencyTests-371721690 None] Created volume successfully. Feb 26 03:36:23 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1" returned: 0 in 0.582s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb054ad-991b-4b37-bfb3-d708d56b7eed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc59108-ea16-49de-92aa-2d6b8a174098]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:23 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:23 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed Feb 26 03:36:23 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:24 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe 1073741824" returned: 0 in 0.563s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:24 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe Feb 26 03:36:24 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:24 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed" returned: 0 in 0.566s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:24 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 Feb 26 03:36:24 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:24 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe" returned: 0 in 0.443s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.766s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1889116993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:19Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Creating volume 35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:24 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ef8468-2f7e-48f8-b327-ca88912343c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2652e2-9da5-43a5-9138-5988be624ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:24 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec 1073741824 Feb 26 03:36:24 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:24 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe (dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe): created successfully Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2652e2-9da5-43a5-9138-5988be624ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (2844c4a5-d717-4f0f-ae19-da861149c88d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:24 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-13f53b78-70fe-40af-aec3-6aafcfe84a1a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created volume successfully. Feb 26 03:36:24 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1" returned: 0 in 0.465s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:24 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:24 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1 Feb 26 03:36:24 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (cc502776-1930-4e92-b637-390ff0160b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b899391b-425c-4039-8656-549f9373ec5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b899391b-425c-4039-8656-549f9373ec5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1508094003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a2a509-8634-42d2-81f3-9ee33145026a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:25Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4126a960-eee2-4ec1-a382-d16ff48a8d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4126a960-eee2-4ec1-a382-d16ff48a8d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297f0976-f37e-4943-aa01-9a42eeebb452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297f0976-f37e-4943-aa01-9a42eeebb452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a2a509-8634-42d2-81f3-9ee33145026a', 'volume_name': 'volume-31a2a509-8634-42d2-81f3-9ee33145026a', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d156db-cb43-4372-87a7-48a356f6dfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d156db-cb43-4372-87a7-48a356f6dfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a536818-e81f-4df5-8490-20b345fb4525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:25 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume 31a2a509-8634-42d2-81f3-9ee33145026a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a2a509-8634-42d2-81f3-9ee33145026a', 'volume_size': 1} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:25 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed.6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1" returned: 0 in 0.443s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1" released by "_delete_snapshot" :: held 2.124s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-adb054ad-991b-4b37-bfb3-d708d56b7eed" released by "delete_snapshot" :: held 2.140s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:25 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec 1073741824" returned: 0 in 0.566s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Created reservations ['1827a47e-5ad4-4be2-a37d-37537c69455d', '80a25236-ffee-428d-b1d7-cd6c384608b3', 'a02455bc-4560-418d-8253-965818f5e4aa', '428ec80e-2491-49d1-b740-6fe0879f8eaf'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:25 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec Feb 26 03:36:25 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:25 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Delete snapshot completed successfully. Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b6f0eb3d-4e45-471e-af90-d8a1a62fe942 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-6d87ef91-4454-4b6d-8fb6-b8bae9f7bcb1-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:25 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec" returned: 0 in 0.381s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.480s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964946036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c05b95-d695-4b38-a325-1f839e1df9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:19Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Creating volume 56c05b95-d695-4b38-a325-1f839e1df9ea {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:25 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27bd789-18ec-43ea-bfc6-b44037627cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:25 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea 1073741824 Feb 26 03:36:25 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773e962c-af3f-49c3-9670-5e787d9acd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:25 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec (35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec): created successfully Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773e962c-af3f-49c3-9670-5e787d9acd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:25 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (052d4a8b-06f8-48ec-8f88-63bcb8c04e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:25 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a0895be9-4786-4c25-9118-b08a4dc4a3b7 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created volume successfully. Feb 26 03:36:26 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea 1073741824" returned: 0 in 0.485s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:26 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea Feb 26 03:36:26 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-adb054ad-991b-4b37-bfb3-d708d56b7eed-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-adb054ad-991b-4b37-bfb3-d708d56b7eed-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-quobyte-adb054ad-991b-4b37-bfb3-d708d56b7eed" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-adb054ad-991b-4b37-bfb3-d708d56b7eed" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea89b5d-c905-4a25-9d06-52dba83dc93d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:26 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed Feb 26 03:36:26 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:26 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea" returned: 0 in 0.409s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.190s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1673291574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8962019-07f3-4545-bad9-03f55d06e36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:19Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Creating volume f8962019-07f3-4545-bad9-03f55d06e36a {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:26 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0672846b-df57-4762-8ee0-eb1317898c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c05b95-d695-4b38-a325-1f839e1df9ea', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:26 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a 1073741824 Feb 26 03:36:26 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d6143e-a23b-4830-8b1f-ccf07b3c356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:26 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume volume-56c05b95-d695-4b38-a325-1f839e1df9ea (56c05b95-d695-4b38-a325-1f839e1df9ea): created successfully Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d6143e-a23b-4830-8b1f-ccf07b3c356a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (e2ee2b00-16ea-4158-8e65-20063eeea0a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:26 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4ec472ae-b6f5-4420-b294-46365055f001 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created volume successfully. Feb 26 03:36:26 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed" returned: 0 in 0.475s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:26 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:26 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed Feb 26 03:36:26 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:27 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a 1073741824" returned: 0 in 0.515s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:27 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a Feb 26 03:36:27 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:27 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-adb054ad-991b-4b37-bfb3-d708d56b7eed" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-adb054ad-991b-4b37-bfb3-d708d56b7eed" released by "delete_volume" :: held 0.954s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Created reservations ['b7cff37f-8f9b-42ef-93f7-863525872ec4', '5394372a-a989-4e44-9913-97c64c4d42af', 'ba63ef80-3ed2-4eb1-baf3-e5419c1f8edc', 'f48aad8b-810f-41d7-8d84-78d23cd9a576'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:27 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:27 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Flow 'volume_create_manager' (736d2b65-f6a0-4b56-8062-7652a064f3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f384ddd8-618a-4c69-b83b-804d438b8b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f384ddd8-618a-4c69-b83b-804d438b8b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-353856495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b485d72-4f4d-4e54-8289-94e4e1cc6a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1234f8f1e4a344968e3cd3dd449e3405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:28Z,use_quota=True,user_id='0f3a7f02d5794d04874b6f51ea0493ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3698f6f8-9c4f-405f-80db-7c66a35cd208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3698f6f8-9c4f-405f-80db-7c66a35cd208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50f08c1-6263-42e4-a5c3-21dd515de2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50f08c1-6263-42e4-a5c3-21dd515de2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b485d72-4f4d-4e54-8289-94e4e1cc6a87', 'volume_name': 'volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26688936-8437-454d-b6f0-3a2a0ea51efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:27 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26688936-8437-454d-b6f0-3a2a0ea51efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff04963-25d0-4184-9011-38abc3856da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:27 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Volume 8b485d72-4f4d-4e54-8289-94e4e1cc6a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87', 'volume_size': 1} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a" returned: 0 in 0.472s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.019s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-613515883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b35498-a3aa-44f7-b17c-5a2d0191f537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d6b2b7e9d74a31ab89572a0f307b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:20Z,use_quota=True,user_id='0391d595a2ce45b9b251983e097b1036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Creating volume 95b35498-a3aa-44f7-b17c-5a2d0191f537 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:27 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bfc817-ea13-46a5-b52b-7434a991197a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8962019-07f3-4545-bad9-03f55d06e36a', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedc4030-7a0b-44ef-a83a-559280cae594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:27 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537 1073741824 Feb 26 03:36:27 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:27 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume volume-f8962019-07f3-4545-bad9-03f55d06e36a (f8962019-07f3-4545-bad9-03f55d06e36a): created successfully Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedc4030-7a0b-44ef-a83a-559280cae594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (8ca67ec3-1ce6-4ec4-a683-06ac7d51d17e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:27 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-bd136f97-a8a6-4df2-a4a4-26881b3b90bb tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created volume successfully. Feb 26 03:36:27 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.413s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:27 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Deleted volume successfully. Feb 26 03:36:27 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-47c8cdbe-3f12-4126-9bec-ce5e49dcaa2a tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-adb054ad-991b-4b37-bfb3-d708d56b7eed-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:28 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537 1073741824" returned: 0 in 0.498s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:28 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537 Feb 26 03:36:28 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:28 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537" returned: 0 in 0.422s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.349s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1688a842-c17f-4544-83c5-d43247dbfedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b35498-a3aa-44f7-b17c-5a2d0191f537', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f528cd57-d1f3-41ea-b008-b1f12940b53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Creating offline snapshot 93331862-05c6-48a2-a76d-be429f3d6990 of volume 1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:36:28 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Volume volume-95b35498-a3aa-44f7-b17c-5a2d0191f537 (95b35498-a3aa-44f7-b17c-5a2d0191f537): created successfully Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f528cd57-d1f3-41ea-b008-b1f12940b53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Flow 'volume_create_manager' (6862a6b3-8997-426a-ae40-e4ec22ecc227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbda82e-237a-4d50-8a83-1e48c23ffcf4]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:28 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:28 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-48f15b88-bc14-46f6-9a45-ac5dd69ff39e tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created volume successfully. Feb 26 03:36:28 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 Feb 26 03:36:28 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:29 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90" returned: 0 in 0.456s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:29 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 1G Feb 26 03:36:29 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-95b35498-a3aa-44f7-b17c-5a2d0191f537-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-95b35498-a3aa-44f7-b17c-5a2d0191f537-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-quobyte-95b35498-a3aa-44f7-b17c-5a2d0191f537" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-95b35498-a3aa-44f7-b17c-5a2d0191f537" acquired by "delete_volume" :: waited 0.020s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5bdc96-539e-4779-8378-614788a4345c]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:29 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537 Feb 26 03:36:29 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:29 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 1G" returned: 0 in 0.476s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1861a7e1-2399-4f1b-9063-d5788d367f90 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:29 devstack sudo[91430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1861a7e1-2399-4f1b-9063-d5788d367f90 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 Feb 26 03:36:29 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:29 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537" returned: 0 in 0.469s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:29 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537 Feb 26 03:36:29 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:29 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1861a7e1-2399-4f1b-9063-d5788d367f90 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990" returned: 0 in 0.394s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:29 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 is being set with open permissions: ugo+rw Feb 26 03:36:29 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:30 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 Feb 26 03:36:30 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:30 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-95b35498-a3aa-44f7-b17c-5a2d0191f537" returned: 0 in 0.416s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-95b35498-a3aa-44f7-b17c-5a2d0191f537" released by "delete_volume" :: held 0.908s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created reservations ['2d682185-7836-4c6d-92de-2aa6ab0d2465', 'c2b1d87a-ed97-46ea-8c2f-bb9acb8341cf', '8f338d98-ea1e-47cd-8f41-16da1cb4bc71', '6a9eff3a-2ddb-46a9-8174-6254bba9a474'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:30 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990" returned: 0 in 0.395s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:30 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:30 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:30 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.info Feb 26 03:36:30 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-f8962019-07f3-4545-bad9-03f55d06e36a-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-f8962019-07f3-4545-bad9-03f55d06e36a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-quobyte-f8962019-07f3-4545-bad9-03f55d06e36a" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-f8962019-07f3-4545-bad9-03f55d06e36a" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[28efca40-2fc3-4698-ab35-bbd5dd51bd44]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:30 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a Feb 26 03:36:30 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:30 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.424s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:30 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Deleted volume successfully. Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-4111b5f4-c663-4055-ad5a-92903fce3cce tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-95b35498-a3aa-44f7-b17c-5a2d0191f537-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:30 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.info" returned: 0 in 0.458s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:30 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.info is being set with open permissions: ugo+rw Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:30 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.info Feb 26 03:36:30 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:30 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a" returned: 0 in 0.469s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:30 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:31 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a Feb 26 03:36:31 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:31 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.info" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.147s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1508094003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a2a509-8634-42d2-81f3-9ee33145026a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:25Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Creating volume 31a2a509-8634-42d2-81f3-9ee33145026a {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:31 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:31 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a 1073741824 Feb 26 03:36:31 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:31 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a35e91f6-3c9b-41db-bbd9-1a87660f31c1 tempest-SnapshotDependencyTests-371721690 None] Create snapshot completed successfully Feb 26 03:36:31 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f8962019-07f3-4545-bad9-03f55d06e36a" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-f8962019-07f3-4545-bad9-03f55d06e36a" released by "delete_volume" :: held 0.941s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created reservations ['c2581ead-a38b-4e52-adeb-e9723604103c', '6da7d70c-9127-4d8f-b71c-e1d68a703696', 'c540b2c0-68fb-41eb-b133-27ef09f0e957', '4072b5b1-8c27-4376-a7c3-09ac57010034'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:31 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:31 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-56c05b95-d695-4b38-a325-1f839e1df9ea-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-56c05b95-d695-4b38-a325-1f839e1df9ea-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-quobyte-56c05b95-d695-4b38-a325-1f839e1df9ea" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-56c05b95-d695-4b38-a325-1f839e1df9ea" acquired by "delete_volume" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c26051-3a0f-4f53-8e78-f136c768067b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:31 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea Feb 26 03:36:31 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:31 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a 1073741824" returned: 0 in 0.514s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:31 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a Feb 26 03:36:31 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Flow 'volume_create_manager' (0e46026e-666a-4d29-8a7c-1e71ea15485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966ce5e9-b817-42f9-b53e-92c8f54e03cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966ce5e9-b817-42f9-b53e-92c8f54e03cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7655e7af-8338-4f5f-8b94-84f8cb1cc366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826a6dd3a3404e98879253bd9b721e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93331862-05c6-48a2-a76d-be429f3d6990,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:32Z,use_quota=True,user_id='2481e30d1c694793a90f922cc4648f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ff58e7-e578-453c-8195-a623a3fae68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ff58e7-e578-453c-8195-a623a3fae68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a3f229-6f8a-4f2a-8cdf-fb51cc044885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a3f229-6f8a-4f2a-8cdf-fb51cc044885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7655e7af-8338-4f5f-8b94-84f8cb1cc366', 'volume_name': 'volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366', 'volume_size': 1, 'snapshot_id': '93331862-05c6-48a2-a76d-be429f3d6990'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8e0a0c-0f2d-4b62-b920-70003586580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8e0a0c-0f2d-4b62-b920-70003586580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9e4b52-3055-4742-b18f-88a4ac52579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:31 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Volume 7655e7af-8338-4f5f-8b94-84f8cb1cc366: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366', 'volume_size': 1, 'snapshot_id': '93331862-05c6-48a2-a76d-be429f3d6990'} Feb 26 03:36:31 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_service.periodic_task [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:32 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.563s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:32 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:32 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:32 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Deleted volume successfully. Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-2f42766b-d023-47f7-b0f8-d886d8415d9f tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-f8962019-07f3-4545-bad9-03f55d06e36a-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:32 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea" returned: 0 in 0.545s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:32 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea Feb 26 03:36:32 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:32 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a" returned: 0 in 0.410s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.560s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-353856495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b485d72-4f4d-4e54-8289-94e4e1cc6a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1234f8f1e4a344968e3cd3dd449e3405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:28Z,use_quota=True,user_id='0f3a7f02d5794d04874b6f51ea0493ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Creating volume 8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:32 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a536818-e81f-4df5-8490-20b345fb4525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a2a509-8634-42d2-81f3-9ee33145026a', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:32 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 1073741824 Feb 26 03:36:32 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8833fe-ed38-4154-a5b6-cf396545746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume volume-31a2a509-8634-42d2-81f3-9ee33145026a (31a2a509-8634-42d2-81f3-9ee33145026a): created successfully Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8833fe-ed38-4154-a5b6-cf396545746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (cc502776-1930-4e92-b637-390ff0160b7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:32 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-1b01834a-0133-43b3-948a-ac89713a5eef tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created volume successfully. Feb 26 03:36:32 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.442s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-17e82317-4df4-4522-ba6c-3989162dff33 None None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:32 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-56c05b95-d695-4b38-a325-1f839e1df9ea" returned: 0 in 0.485s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (36120391-296b-4268-816f-c891f7205a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d546b99c-5b02-44ca-b0a6-5d35e86db7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-56c05b95-d695-4b38-a325-1f839e1df9ea" released by "delete_volume" :: held 1.088s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d546b99c-5b02-44ca-b0a6-5d35e86db7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301716760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c0d792-4cb2-40f1-ac80-e04905474fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:33Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059c635e-663b-4f29-9e1e-593e42844f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059c635e-663b-4f29-9e1e-593e42844f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11adfc01-8d34-4e35-97e3-2180e38b455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11adfc01-8d34-4e35-97e3-2180e38b455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c0d792-4cb2-40f1-ac80-e04905474fb1', 'volume_name': 'volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b6605c-4d2b-4342-b046-575b4650fbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b6605c-4d2b-4342-b046-575b4650fbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69220533-acd4-4d38-a344-d75eeb715a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume b0c0d792-4cb2-40f1-ac80-e04905474fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1', 'volume_size': 1} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:32 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 1073741824" returned: 0 in 0.526s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created reservations ['7c2f2596-e42b-4cac-b84f-05edb83cec28', '7d5c1ab9-113e-4f78-abfb-e314a5fb595d', '11de5525-5824-4a74-9fc7-c48013090261', 'e0344cd6-7288-402d-bad4-d6cddd7bf665'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:32 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 Feb 26 03:36:32 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (3b9498d8-ac0d-4186-bdcc-9e1619a330fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653099f9-f0dc-4117-8d42-4d67e2f6ec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653099f9-f0dc-4117-8d42-4d67e2f6ec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-381497595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c499fb-9f1a-4034-ab30-99c644d19845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:33Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb32ea5-dc82-466b-946f-4df2bb85be8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb32ea5-dc82-466b-946f-4df2bb85be8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:32 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd05b372-eab3-40a1-a00d-c6e62f67bc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd05b372-eab3-40a1-a00d-c6e62f67bc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c499fb-9f1a-4034-ab30-99c644d19845', 'volume_name': 'volume-a8c499fb-9f1a-4034-ab30-99c644d19845', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8374d7-b87d-4ebc-973a-f9044ad76ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8374d7-b87d-4ebc-973a-f9044ad76ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564927ad-e4ba-46aa-be57-e0037b75ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:32 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume a8c499fb-9f1a-4034-ab30-99c644d19845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c499fb-9f1a-4034-ab30-99c644d19845', 'volume_size': 1} Feb 26 03:36:32 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (1e1ad0ad-0aa4-47c8-b551-6a3eaa8976d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0105b87a-e127-496d-92e5-3a1d3d6f7dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0105b87a-e127-496d-92e5-3a1d3d6f7dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095391705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502b78ac-604b-4030-9c93-47de526b473b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:33Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2175b366-8beb-4d8a-b635-26a83cfdaa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2175b366-8beb-4d8a-b635-26a83cfdaa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d2365a-5cfe-4644-936e-67a48f7ab7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d2365a-5cfe-4644-936e-67a48f7ab7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502b78ac-604b-4030-9c93-47de526b473b', 'volume_name': 'volume-502b78ac-604b-4030-9c93-47de526b473b', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2980c721-5ce0-46cc-8339-ae0ad02c9401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2980c721-5ce0-46cc-8339-ae0ad02c9401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fbb9e3-1437-4442-9d4e-1cc716c67047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume 502b78ac-604b-4030-9c93-47de526b473b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502b78ac-604b-4030-9c93-47de526b473b', 'volume_size': 1} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (060a0aaa-0576-4e7e-a064-5b2635b9f9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b4287a-e849-49c0-8880-18b012d23336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b4287a-e849-49c0-8880-18b012d23336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1786742934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e998bb4a-4d60-4807-8eee-98a8bc77dd0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:33Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14acf383-4bf7-4479-a3aa-4f7642fa8c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14acf383-4bf7-4479-a3aa-4f7642fa8c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb8c9cc-461d-4290-ba32-18cf0e1e1c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb8c9cc-461d-4290-ba32-18cf0e1e1c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e998bb4a-4d60-4807-8eee-98a8bc77dd0e', 'volume_name': 'volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b801c632-0dbd-415e-a938-ab3f8b368849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b801c632-0dbd-415e-a938-ab3f8b368849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c8dfb7-98e4-4f68-b588-4f3601731667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume e998bb4a-4d60-4807-8eee-98a8bc77dd0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e', 'volume_size': 1} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87" returned: 0 in 0.539s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.358s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "cinder-quobyte-93331862-05c6-48a2-a76d-be429f3d6990-7655e7af-8338-4f5f-8b94-84f8cb1cc366" by "_create_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff04963-25d0-4184-9011-38abc3856da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a38690-b0e1-4836-aa54-541974d9b1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Volume volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 (8b485d72-4f4d-4e54-8289-94e4e1cc6a87): created successfully Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a38690-b0e1-4836-aa54-541974d9b1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Flow 'volume_create_manager' (736d2b65-f6a0-4b56-8062-7652a064f3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-93331862-05c6-48a2-a76d-be429f3d6990-7655e7af-8338-4f5f-8b94-84f8cb1cc366" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Creating volume 7655e7af-8338-4f5f-8b94-84f8cb1cc366 from snapshot 93331862-05c6-48a2-a76d-be429f3d6990 {{(pid=83121) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "cinder-quobyte-7655e7af-8338-4f5f-8b94-84f8cb1cc366" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9b686dd0-7879-4bb8-959b-dfdee9858d1b tempest-VolumeDependencyTests-1909018923 None] Created volume successfully. Feb 26 03:36:33 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.500s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:33 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Deleted volume successfully. Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-7655e7af-8338-4f5f-8b94-84f8cb1cc366" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] snapshot: 93331862-05c6-48a2-a76d-be429f3d6990, volume: 7655e7af-8338-4f5f-8b94-84f8cb1cc366, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-9122ff30-7c50-4a5f-84c2-0867ecca3f09 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-56c05b95-d695-4b38-a325-1f839e1df9ea-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a68d2e-cfb7-47e0-a96b-3226d177136d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (64089d80-269d-4fb5-9a8c-392869fe0729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762eb2b9-a9a1-4ab1-b4b4-27ea9556c0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762eb2b9-a9a1-4ab1-b4b4-27ea9556c0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331971600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55c4fa6-e559-4d15-88e7-8386af855a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:33Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4aea62-aabd-4555-a81f-5e5083b0d05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4aea62-aabd-4555-a81f-5e5083b0d05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e5bcb3-a8a3-45e5-8aa1-38c3e05fae13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e5bcb3-a8a3-45e5-8aa1-38c3e05fae13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55c4fa6-e559-4d15-88e7-8386af855a58', 'volume_name': 'volume-a55c4fa6-e559-4d15-88e7-8386af855a58', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba40f9c-0631-4cf4-82f1-da5e8fc5807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba40f9c-0631-4cf4-82f1-da5e8fc5807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1ab6df-f168-4b3f-928a-e7457ec1756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:33 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume a55c4fa6-e559-4d15-88e7-8386af855a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55c4fa6-e559-4d15-88e7-8386af855a58', 'volume_size': 1} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:33 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 Feb 26 03:36:33 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-quobyte-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec" acquired by "delete_volume" :: waited 0.006s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b3f6cf-0548-43d2-8cf4-2ba246d958a2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:33 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec Feb 26 03:36:33 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:33 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990" returned: 0 in 0.525s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1861a7e1-2399-4f1b-9063-d5788d367f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9602a44c-3de6-4c79-ab9f-1298f4738143]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:33 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:34 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 Feb 26 03:36:34 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Flow 'volume_create_manager' (343f1ae9-9793-4757-b186-59528db36d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283fb884-7f24-4322-8fb6-e47dee3b4bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283fb884-7f24-4322-8fb6-e47dee3b4bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2033525538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e0308b-0611-481b-be58-f1703915de9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1234f8f1e4a344968e3cd3dd449e3405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8b485d72-4f4d-4e54-8289-94e4e1cc6a87,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:34Z,use_quota=True,user_id='0f3a7f02d5794d04874b6f51ea0493ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5017c10-b960-41ac-b8b8-eaa06dbb8f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5017c10-b960-41ac-b8b8-eaa06dbb8f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c95ff2-5c5a-4cba-b470-3c13b3cb3505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c95ff2-5c5a-4cba-b470-3c13b3cb3505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '40e0308b-0611-481b-be58-f1703915de9a', 'volume_name': 'volume-40e0308b-0611-481b-be58-f1703915de9a', 'volume_size': 1, 'source_volid': '8b485d72-4f4d-4e54-8289-94e4e1cc6a87', 'source_volstatus': 'available'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aea6290-ce9e-4040-afa1-a9771e4254aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aea6290-ce9e-4040-afa1-a9771e4254aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (facb6225-9ffa-4910-a8ce-fb9d21d80e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:34 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Volume 40e0308b-0611-481b-be58-f1703915de9a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-40e0308b-0611-481b-be58-f1703915de9a', 'volume_size': 1, 'source_volid': '8b485d72-4f4d-4e54-8289-94e4e1cc6a87', 'source_volstatus': 'available'} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:34 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec" returned: 0 in 0.530s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:34 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec Feb 26 03:36:34 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:34 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90" returned: 0 in 0.477s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:34 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 Feb 26 03:36:34 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:34 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec" returned: 0 in 0.446s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec" released by "delete_volume" :: held 1.006s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created reservations ['566d15ed-7999-4fc3-a644-754fc4303730', 'c2783572-49c1-430b-b7f8-2e9da6795cdd', '2b351bfc-a666-481e-a046-39e181e1c718', 'b8f86b43-6f0e-49f0-affe-94c8621a21aa'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:34 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:35 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:35 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-quobyte-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe" acquired by "delete_volume" :: waited 0.047s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf7240e-c55c-4cac-9636-4074faf3ebdc]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:36 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 1.440s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:36 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Deleted volume successfully. Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-7be18d8c-15b3-45d2-bfc9-7cfb8fcc1648 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-35ddc1c4-b5b3-4ae5-92a6-74cea57a4dec-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:36 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe Feb 26 03:36:36 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:36 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366" returned: 0 in 2.170s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a18378-ca32-4fb4-a707-f6dd6fba9bd2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:36 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 Feb 26 03:36:36 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:36 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe" returned: 0 in 0.618s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:36 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:36 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe Feb 26 03:36:36 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:37 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90" returned: 0 in 0.564s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:36:37 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Converted 1024.00 MB image at 471.72 MB/s Feb 26 03:36:37 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 is being set with open permissions: ugo+rw Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:37 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 Feb 26 03:36:37 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:37 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe" returned: 0 in 0.426s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe" released by "delete_volume" :: held 1.090s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created reservations ['b6d8ae6b-77e4-4609-99fc-5d78e7759096', 'e66e7c09-250d-4c2b-809f-5fb32a0fe50d', 'ada760be-9122-45eb-b484-4bb5aa85b985', 'd929b68f-12ce-4295-8954-c6773cb3441b'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:37 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:37 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:37 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366" returned: 0 in 0.411s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-7655e7af-8338-4f5f-8b94-84f8cb1cc366" released by "_copy_volume_from_snapshot" :: held 4.216s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-93331862-05c6-48a2-a76d-be429f3d6990-7655e7af-8338-4f5f-8b94-84f8cb1cc366" released by "_create_volume_from_snapshot" :: held 4.246s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.276s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.893s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301716760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c0d792-4cb2-40f1-ac80-e04905474fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:33Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Creating volume b0c0d792-4cb2-40f1-ac80-e04905474fb1 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:37 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9e4b52-3055-4742-b18f-88a4ac52579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366', 'volume_size': 1, 'snapshot_id': '93331862-05c6-48a2-a76d-be429f3d6990'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2de2794-8c07-4f12-859f-c1c3d07f271e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:37 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1 1073741824 Feb 26 03:36:37 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:37 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Volume volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 (7655e7af-8338-4f5f-8b94-84f8cb1cc366): created successfully Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2de2794-8c07-4f12-859f-c1c3d07f271e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Flow 'volume_create_manager' (0e46026e-666a-4d29-8a7c-1e71ea15485a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:37 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-145db96d-315a-4ced-9cc2-e56fdca42ad5 tempest-SnapshotDependencyTests-371721690 None] Created volume successfully. Feb 26 03:36:37 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.371s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:37 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Deleted volume successfully. Feb 26 03:36:37 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-e98c0322-f9d3-403f-ab7b-05de79a18364 tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-dd10fb67-c31d-4be5-9c80-3e9a2cc4d6fe-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:38 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1 1073741824" returned: 0 in 0.464s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:38 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1 Feb 26 03:36:38 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "cinder-93331862-05c6-48a2-a76d-be429f3d6990-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-93331862-05c6-48a2-a76d-be429f3d6990-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "cinder-quobyte-1861a7e1-2399-4f1b-9063-d5788d367f90" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-1861a7e1-2399-4f1b-9063-d5788d367f90" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "cinder-quobyte-93331862-05c6-48a2-a76d-be429f3d6990" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-fcb08456-652c-453c-a867-ea8d305e4827-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-93331862-05c6-48a2-a76d-be429f3d6990" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Deleting offline snapshot 93331862-05c6-48a2-a76d-be429f3d6990 of volume 1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] snapshot_file for this snap is: volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-fcb08456-652c-453c-a867-ea8d305e4827-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-quobyte-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2bae0a-8623-4c12-84aa-ece419110a17]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-quobyte-fcb08456-652c-453c-a867-ea8d305e4827" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-fcb08456-652c-453c-a867-ea8d305e4827" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Deleting offline snapshot fcb08456-652c-453c-a867-ea8d305e4827 of volume e308ff1d-15fb-4ce5-9fe2-e87176dbb1be {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] snapshot_file for this snap is: volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ba5712-7359-4ff7-a32d-9ce39d35e8a7]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:38 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 Feb 26 03:36:38 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:38 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1" returned: 0 in 0.453s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.643s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-381497595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c499fb-9f1a-4034-ab30-99c644d19845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:33Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Creating volume a8c499fb-9f1a-4034-ab30-99c644d19845 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:38 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:38 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 Feb 26 03:36:38 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69220533-acd4-4d38-a344-d75eeb715a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:38 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845 1073741824 Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff5162d-cf04-4ad2-b252-b38f96297610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:38 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:38 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1 (b0c0d792-4cb2-40f1-ac80-e04905474fb1): created successfully Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff5162d-cf04-4ad2-b252-b38f96297610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (36120391-296b-4268-816f-c891f7205a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:38 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-d0495e95-f763-4b07-b0dd-e9b5e8889636 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created volume successfully. Feb 26 03:36:38 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990" returned: 0 in 0.523s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:38 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1861a7e1-2399-4f1b-9063-d5788d367f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bc78bf-c21d-4b67-8ad4-734928bf3beb]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:39 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827" returned: 0 in 0.548s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:36:39 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845 1073741824" returned: 0 in 0.486s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d5cf5a-c187-474d-86ef-a67bb08c2201]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:39 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 Feb 26 03:36:39 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:39 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845 Feb 26 03:36:39 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:39 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be Feb 26 03:36:39 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:39 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:39 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 Feb 26 03:36:39 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:39 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845" returned: 0 in 0.414s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.436s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095391705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502b78ac-604b-4030-9c93-47de526b473b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:33Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Creating volume 502b78ac-604b-4030-9c93-47de526b473b {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:39 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:39 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564927ad-e4ba-46aa-be57-e0037b75ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c499fb-9f1a-4034-ab30-99c644d19845', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb840a65-0a20-48bc-8838-8058dd055ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:39 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b 1073741824 Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" returned: 0 in 0.513s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:39 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:39 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume volume-a8c499fb-9f1a-4034-ab30-99c644d19845 (a8c499fb-9f1a-4034-ab30-99c644d19845): created successfully Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb840a65-0a20-48bc-8838-8058dd055ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:39 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 Feb 26 03:36:39 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (3b9498d8-ac0d-4186-bdcc-9e1619a330fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:39 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-213360fb-abb0-4a4e-88d8-a3717a1f8be1 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created volume successfully. Feb 26 03:36:39 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:39 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:39 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990 Feb 26 03:36:39 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:40 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b 1073741824" returned: 0 in 0.537s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:40 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827" returned: 0 in 0.512s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:40 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b Feb 26 03:36:40 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:40 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827 Feb 26 03:36:40 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:40 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90.93331862-05c6-48a2-a76d-be429f3d6990" returned: 0 in 0.433s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-93331862-05c6-48a2-a76d-be429f3d6990" released by "_delete_snapshot" :: held 1.934s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-1861a7e1-2399-4f1b-9063-d5788d367f90" released by "delete_snapshot" :: held 1.966s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Created reservations ['66d6c96d-c73c-4778-8b05-f311dc86412d', 'bc307086-c0a0-41f0-9d88-60850cf74672', 'da5685b0-0718-42ed-9176-43d786a19517', 'b3971f23-b1e9-40e8-83d6-fd318c1edd7e'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:40 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Delete snapshot completed successfully. Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-29207b51-8afd-4af0-aae9-478aadc41483 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-93331862-05c6-48a2-a76d-be429f3d6990-delete_snapshot" released by "delete_snapshot" :: held 2.061s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:40 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b" returned: 0 in 0.401s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.166s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1786742934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e998bb4a-4d60-4807-8eee-98a8bc77dd0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:33Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Creating volume e998bb4a-4d60-4807-8eee-98a8bc77dd0e {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:40 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "cinder-1861a7e1-2399-4f1b-9063-d5788d367f90-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:40 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e 1073741824 Feb 26 03:36:40 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:40 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fbb9e3-1437-4442-9d4e-1cc716c67047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502b78ac-604b-4030-9c93-47de526b473b', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b39dfa0-b768-4d2a-8e95-e4f4bd578016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-1861a7e1-2399-4f1b-9063-d5788d367f90-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be.fcb08456-652c-453c-a867-ea8d305e4827" returned: 0 in 0.458s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:40 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume volume-502b78ac-604b-4030-9c93-47de526b473b (502b78ac-604b-4030-9c93-47de526b473b): created successfully Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b39dfa0-b768-4d2a-8e95-e4f4bd578016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (1e1ad0ad-0aa4-47c8-b551-6a3eaa8976d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:40 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-2abee431-de79-49d7-ac01-c550eb04babf tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created volume successfully. Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-fcb08456-652c-453c-a867-ea8d305e4827" released by "_delete_snapshot" :: held 2.120s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" released by "delete_snapshot" :: held 2.153s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "cinder-quobyte-1861a7e1-2399-4f1b-9063-d5788d367f90" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-1861a7e1-2399-4f1b-9063-d5788d367f90" acquired by "delete_volume" :: waited 0.020s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7505b80a-b8c4-48b2-b818-21923a140a3d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created reservations ['22511639-2649-4562-9821-38344f084483', 'd2ee2ae1-f341-437c-9244-aab3ba6bc086', '5f5b5e2f-f1a3-485c-8128-7a7af5795eb4', 'b901e732-1060-49ce-9f75-623d2dbfcb4f'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:40 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Delete snapshot completed successfully. Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b104500d-f2c9-4f32-8790-be5a924cdefd tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-fcb08456-652c-453c-a867-ea8d305e4827-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:40 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 Feb 26 03:36:40 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "cinder-quobyte-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4991e0-d603-4105-b7c4-eb3d28909bb0]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:40 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:40 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be Feb 26 03:36:40 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:41 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e 1073741824" returned: 0 in 0.538s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:41 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e Feb 26 03:36:41 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:41 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90" returned: 0 in 0.527s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:41 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90 Feb 26 03:36:41 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:41 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" returned: 0 in 0.485s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:41 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be Feb 26 03:36:41 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:41 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e" returned: 0 in 0.411s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.981s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331971600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55c4fa6-e559-4d15-88e7-8386af855a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b624ca6e05ce454bb81be07cf8cb457a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:33Z,use_quota=True,user_id='8313d59aeb594a9589098e9e1c204fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Creating volume a55c4fa6-e559-4d15-88e7-8386af855a58 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:41 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c8dfb7-98e4-4f68-b588-4f3601731667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:41 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58 1073741824 Feb 26 03:36:41 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a73183-c3b3-471f-b57c-60f5ca436853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:41 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e (e998bb4a-4d60-4807-8eee-98a8bc77dd0e): created successfully Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a73183-c3b3-471f-b57c-60f5ca436853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (060a0aaa-0576-4e7e-a064-5b2635b9f9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:41 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-0fe30a54-5c0a-4112-9a27-841109764057 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created volume successfully. Feb 26 03:36:41 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-1861a7e1-2399-4f1b-9063-d5788d367f90" returned: 0 in 0.397s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-1861a7e1-2399-4f1b-9063-d5788d367f90" released by "delete_volume" :: held 0.957s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Created reservations ['5bf69a85-d38c-4284-9199-349c9b6eb31d', 'fba6a0e2-8c93-44b1-8df9-36a40482444f', 'fef93b95-7cad-4d12-9929-3bf2fdee30a9', 'efbc7123-d89a-42c3-8d64-271095660030'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:41 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:41 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:41 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" returned: 0 in 0.421s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-quobyte-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be" released by "delete_volume" :: held 0.940s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Created reservations ['899ffae7-99e8-41a8-8ef0-38474b008fd8', '5a6b965c-cf9e-445b-b7ae-25bd9139414e', '07d3da98-d17d-4ba9-93d7-cffc593e361c', 'c40e8807-bcb6-415b-bbcd-9d52fbb1e343'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:41 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:41 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:41 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:42 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58 1073741824" returned: 0 in 0.504s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:42 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58 Feb 26 03:36:42 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:42 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:42 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Deleted volume successfully. Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c7e4de4b-41d1-4a1d-a936-f5b7ce559ce8 tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-1861a7e1-2399-4f1b-9063-d5788d367f90-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:42 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.565s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:42 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Deleted volume successfully. Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-43b5176d-6f16-43ec-ad29-a376907df92a tempest-CreateVolumesFromSnapshotTest-1276905194 None] Lock "cinder-e308ff1d-15fb-4ce5-9fe2-e87176dbb1be-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:42 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58" returned: 0 in 0.487s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.200s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:42 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Cloning volume 8b485d72-4f4d-4e54-8289-94e4e1cc6a87 to volume 40e0308b-0611-481b-be58-f1703915de9a Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1ab6df-f168-4b3f-928a-e7457ec1756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55c4fa6-e559-4d15-88e7-8386af855a58', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e217a680-2919-417a-815d-dd88af0e20c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:42 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Volume volume-a55c4fa6-e559-4d15-88e7-8386af855a58 (a55c4fa6-e559-4d15-88e7-8386af855a58): created successfully Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e217a680-2919-417a-815d-dd88af0e20c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Flow 'volume_create_manager' (64089d80-269d-4fb5-9a8c-392869fe0729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Creating offline snapshot 448f9791-90fc-414a-9e57-403bda8afa6d of volume 8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:36:42 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-606901a3-2b7a-4c85-b01e-6a561f03ab93 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created volume successfully. Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[195ab7a1-1f9b-466f-bab0-6e1c79158d08]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "cinder-7655e7af-8338-4f5f-8b94-84f8cb1cc366-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-7655e7af-8338-4f5f-8b94-84f8cb1cc366-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "cinder-quobyte-7655e7af-8338-4f5f-8b94-84f8cb1cc366" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:42 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 Feb 26 03:36:42 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-7655e7af-8338-4f5f-8b94-84f8cb1cc366" acquired by "delete_volume" :: waited 0.011s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc452d6-71d8-44c1-b034-070401155d18]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:42 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:42 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 Feb 26 03:36:42 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:43 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87" returned: 0 in 0.600s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-a55c4fa6-e559-4d15-88e7-8386af855a58-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:43 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d 1G Feb 26 03:36:43 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-a55c4fa6-e559-4d15-88e7-8386af855a58-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-quobyte-a55c4fa6-e559-4d15-88e7-8386af855a58" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:43 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-a55c4fa6-e559-4d15-88e7-8386af855a58" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366" returned: 0 in 0.527s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4e069e-8dba-43ed-8652-66d859f445e1]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:43 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366 Feb 26 03:36:43 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:43 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58 Feb 26 03:36:43 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:43 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-7655e7af-8338-4f5f-8b94-84f8cb1cc366" returned: 0 in 0.379s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-quobyte-7655e7af-8338-4f5f-8b94-84f8cb1cc366" released by "delete_volume" :: held 0.928s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Created reservations ['66377c9e-83d5-4a4a-a9b3-ef658d48b1ef', '0444c85f-13e2-4433-82d7-b55802a6743c', '9e49d272-34d4-4a58-8018-d28ad8e7deac', '50f5feb2-956e-4592-a2e0-71a093152998'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:43 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d 1G" returned: 0 in 0.520s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:43 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d Feb 26 03:36:43 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:43 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:43 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:43 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58" returned: 0 in 0.542s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:43 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:43 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58 Feb 26 03:36:43 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:44 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:44 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d is being set with open permissions: ugo+rw Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:44 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.447s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:44 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Deleted volume successfully. Feb 26 03:36:44 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d Feb 26 03:36:44 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-176c23ce-bfa2-480b-be80-1ad7eb604b6d tempest-SnapshotDependencyTests-371721690 None] Lock "cinder-7655e7af-8338-4f5f-8b94-84f8cb1cc366-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:44 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a55c4fa6-e559-4d15-88e7-8386af855a58" returned: 0 in 0.428s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-a55c4fa6-e559-4d15-88e7-8386af855a58" released by "delete_volume" :: held 0.995s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created reservations ['60f0696b-97f1-4692-b024-6e2a7ac680c4', '9b842d34-a800-409c-81ca-40ae05219202', '009341da-3f31-48a7-9ad1-6a90d9e7bb1b', 'f1c7b8ba-bce6-46b7-9d1e-4050524861cf'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:44 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:44 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:44 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d" returned: 0 in 0.481s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:44 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.info Feb 26 03:36:44 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:44 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.440s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:44 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Deleted volume successfully. Feb 26 03:36:44 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-a6d1f491-27fd-49a0-b8de-6c16cfe76493 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-a55c4fa6-e559-4d15-88e7-8386af855a58-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:45 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.info" returned: 0 in 0.427s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:45 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.info is being set with open permissions: ugo+rw Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:45 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.info Feb 26 03:36:45 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-e998bb4a-4d60-4807-8eee-98a8bc77dd0e-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-e998bb4a-4d60-4807-8eee-98a8bc77dd0e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-quobyte-e998bb4a-4d60-4807-8eee-98a8bc77dd0e" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-e998bb4a-4d60-4807-8eee-98a8bc77dd0e" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6febe76e-25cd-4ef2-982f-acc8073e8ffa]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:45 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e Feb 26 03:36:45 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:45 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.info" returned: 0 in 0.465s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-quobyte-40e0308b-0611-481b-be58-f1703915de9a" by "_copy_volume_from_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-40e0308b-0611-481b-be58-f1703915de9a" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] snapshot: 448f9791-90fc-414a-9e57-403bda8afa6d, volume: 40e0308b-0611-481b-be58-f1703915de9a, {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[916582f7-705e-404d-b34c-815bd8188af9]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:45 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:45 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d Feb 26 03:36:45 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:46 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e" returned: 0 in 0.576s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:46 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e Feb 26 03:36:46 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:46 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d" returned: 0 in 0.503s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Creating direct copy from snapshot {{(pid=83121) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8140543-8ce4-4edf-b4c1-cb89304b8c88]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:46 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 Feb 26 03:36:46 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:46 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-e998bb4a-4d60-4807-8eee-98a8bc77dd0e" returned: 0 in 0.520s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-e998bb4a-4d60-4807-8eee-98a8bc77dd0e" released by "delete_volume" :: held 1.118s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:46 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87" returned: 0 in 0.487s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG cinder.utils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Path /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a not found in is_blk_device check {{(pid=83121) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created reservations ['fc196118-4821-49ad-826f-8366d6106c3c', '9245b2e3-f03d-451b-8981-bdb5796baba9', 'a0b4ad17-98b7-4781-8eb2-f84183e71c6a', 'bbf99698-4d03-4679-b8b7-d1b6c8cd92aa'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:46 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a Feb 26 03:36:46 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:46 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:46 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:46 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:47 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.703s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:47 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:47 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Deleted volume successfully. Feb 26 03:36:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-423c0da6-41c1-440e-b559-18be8f66a57d tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-e998bb4a-4d60-4807-8eee-98a8bc77dd0e-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-502b78ac-604b-4030-9c93-47de526b473b-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-502b78ac-604b-4030-9c93-47de526b473b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-quobyte-502b78ac-604b-4030-9c93-47de526b473b" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:47 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-502b78ac-604b-4030-9c93-47de526b473b" acquired by "delete_volume" :: waited 0.019s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:47 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cc7712-2b31-4605-8880-d1d15783ad84]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:47 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:48 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b Feb 26 03:36:48 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:48 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a" returned: 0 in 2.112s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:48 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e855b578-3c94-4262-9914-b7f9dd199350]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:48 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 Feb 26 03:36:48 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:48 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b" returned: 0 in 0.993s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:48 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:48 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b Feb 26 03:36:48 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:49 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-502b78ac-604b-4030-9c93-47de526b473b" returned: 0 in 0.463s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-502b78ac-604b-4030-9c93-47de526b473b" released by "delete_volume" :: held 1.502s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created reservations ['f3fdbe8c-b2fb-4ea5-868b-c54ac775dc47', 'b8ce8917-9d64-4a82-b296-2eb776c0b7cf', 'a8472e60-198a-4f19-a51b-bdfe1c25b5af', '5e864e68-d05a-4380-96aa-ce1f6259b4d5'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:49 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87" returned: 0 in 0.630s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.image.image_utils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Image conversion details: src /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a {{(pid=83121) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 03:36:49 devstack cinder-volume[83121]: INFO cinder.image.image_utils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Converted 1024.00 MB image at 484.34 MB/s Feb 26 03:36:49 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a is being set with open permissions: ugo+rw Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:49 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a Feb 26 03:36:49 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:49 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:49 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:49 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a" returned: 0 in 0.445s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-40e0308b-0611-481b-be58-f1703915de9a" released by "_copy_volume_from_snapshot" :: held 4.222s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-quobyte-448f9791-90fc-414a-9e57-403bda8afa6d" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-448f9791-90fc-414a-9e57-403bda8afa6d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Deleting offline snapshot 448f9791-90fc-414a-9e57-403bda8afa6d of volume 8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] snapshot_file for this snap is: volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:36:49 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e020a9-65d8-4538-a0cd-9ad93690a39b]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.446s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:49 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Deleted volume successfully. Feb 26 03:36:49 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-81ae3a96-2223-40c4-ae12-06e26c03effd tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-502b78ac-604b-4030-9c93-47de526b473b-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:49 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d Feb 26 03:36:49 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-a8c499fb-9f1a-4034-ab30-99c644d19845-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-a8c499fb-9f1a-4034-ab30-99c644d19845-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-quobyte-a8c499fb-9f1a-4034-ab30-99c644d19845" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-a8c499fb-9f1a-4034-ab30-99c644d19845" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2eab86-7a58-4858-b7c4-26cf382340f2]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:50 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845 Feb 26 03:36:50 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:50 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d" returned: 0 in 0.564s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5ce096-e181-470c-b296-22bdcc8b0fe0]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:50 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 Feb 26 03:36:50 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:50 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845" returned: 0 in 0.548s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:50 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845 Feb 26 03:36:50 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:50 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87" returned: 0 in 0.524s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:50 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:50 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d Feb 26 03:36:50 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:51 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-a8c499fb-9f1a-4034-ab30-99c644d19845" returned: 0 in 0.471s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-a8c499fb-9f1a-4034-ab30-99c644d19845" released by "delete_volume" :: held 1.048s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created reservations ['138d8c6e-5477-4d66-89e8-57828f841529', '48c89f75-4b10-49ec-99fb-6507858c2b3d', '948dd9c2-6763-40f4-ada0-c0db8ee3908a', 'faa08ec7-d9b1-4019-a745-52fc1215ccae'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:51 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:51 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:51 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d" returned: 0 in 0.467s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:51 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d Feb 26 03:36:51 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:51 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.412s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:51 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Deleted volume successfully. Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-37eeb41b-5fc3-4ce8-a0c3-46036835c33a tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-a8c499fb-9f1a-4034-ab30-99c644d19845-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:51 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87.448f9791-90fc-414a-9e57-403bda8afa6d" returned: 0 in 0.417s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-448f9791-90fc-414a-9e57-403bda8afa6d" released by "_delete_snapshot" :: held 2.024s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.341s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (facb6225-9ffa-4910-a8ce-fb9d21d80e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e0308b-0611-481b-be58-f1703915de9a', 'volume_size': 1, 'source_volid': '8b485d72-4f4d-4e54-8289-94e4e1cc6a87', 'source_volstatus': 'available'}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca70930-d1d1-4024-8d9b-77d5db3aa6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:51 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Volume volume-40e0308b-0611-481b-be58-f1703915de9a (40e0308b-0611-481b-be58-f1703915de9a): created successfully Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca70930-d1d1-4024-8d9b-77d5db3aa6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:51 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Flow 'volume_create_manager' (343f1ae9-9793-4757-b186-59528db36d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:51 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-53b77fad-53ab-4232-bd75-fafd5208f605 tempest-VolumeDependencyTests-1909018923 None] Created volume successfully. Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-b0c0d792-4cb2-40f1-ac80-e04905474fb1-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-b0c0d792-4cb2-40f1-ac80-e04905474fb1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-quobyte-b0c0d792-4cb2-40f1-ac80-e04905474fb1" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-b0c0d792-4cb2-40f1-ac80-e04905474fb1" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[37131da8-6ed5-47c0-954d-0660e42738e1]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:52 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1 Feb 26 03:36:52 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-8b485d72-4f4d-4e54-8289-94e4e1cc6a87-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-8b485d72-4f4d-4e54-8289-94e4e1cc6a87-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-quobyte-8b485d72-4f4d-4e54-8289-94e4e1cc6a87" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-8b485d72-4f4d-4e54-8289-94e4e1cc6a87" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[250b6f2c-4018-4c37-be59-8272a12e4a6a]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:52 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 Feb 26 03:36:52 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:52 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1" returned: 0 in 0.445s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:52 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1 Feb 26 03:36:52 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:52 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87" returned: 0 in 0.450s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:52 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:52 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87 Feb 26 03:36:52 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:53 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-b0c0d792-4cb2-40f1-ac80-e04905474fb1" returned: 0 in 0.415s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-b0c0d792-4cb2-40f1-ac80-e04905474fb1" released by "delete_volume" :: held 0.883s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created reservations ['ceece655-8cc1-4df7-b51f-5b97b3b56277', 'e8e10819-f76d-40ca-b88e-0c2f112a4aa5', 'f58cc93d-090e-4a5e-8a1c-2045d9d1a2f5', 'ff977397-fb96-408e-849c-dbe63ca21faa'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:53 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:53 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-31a2a509-8634-42d2-81f3-9ee33145026a-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-31a2a509-8634-42d2-81f3-9ee33145026a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "cinder-quobyte-31a2a509-8634-42d2-81f3-9ee33145026a" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-31a2a509-8634-42d2-81f3-9ee33145026a" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f670498-2df1-4f9c-8a4f-24115936c4ff]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:53 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-8b485d72-4f4d-4e54-8289-94e4e1cc6a87" returned: 0 in 0.452s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-8b485d72-4f4d-4e54-8289-94e4e1cc6a87" released by "delete_volume" :: held 0.943s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Created reservations ['535a58ca-b28c-43da-b439-dab62860ee04', '84ac7d9e-8cea-44e2-873d-4976949ba5af', 'c4f8be53-340e-43ee-b4a4-6e11c4b3e08d', '2877baa9-c36e-43f5-b186-dfe7035b40f0'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:53 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a Feb 26 03:36:53 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:53 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:53 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-40e0308b-0611-481b-be58-f1703915de9a-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-40e0308b-0611-481b-be58-f1703915de9a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:53 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-quobyte-40e0308b-0611-481b-be58-f1703915de9a" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.433s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:53 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Deleted volume successfully. Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-40e0308b-0611-481b-be58-f1703915de9a" acquired by "delete_volume" :: waited 0.022s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-b0f720aa-5af1-4527-942d-9fa0a2a4db83 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-b0c0d792-4cb2-40f1-ac80-e04905474fb1-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4826f2-1f56-4012-8828-015544205512]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:53 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a Feb 26 03:36:53 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:53 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a" returned: 0 in 0.513s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:53 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a Feb 26 03:36:53 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:53 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.466s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:53 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Deleted volume successfully. Feb 26 03:36:53 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c3ea4997-432a-43d6-bc6c-e238d0c94cac tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-8b485d72-4f4d-4e54-8289-94e4e1cc6a87-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:54 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a" returned: 0 in 0.479s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:54 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a Feb 26 03:36:54 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:54 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-31a2a509-8634-42d2-81f3-9ee33145026a" returned: 0 in 0.413s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-quobyte-31a2a509-8634-42d2-81f3-9ee33145026a" released by "delete_volume" :: held 0.952s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Created reservations ['9b7b41a9-81f3-4ddb-bb81-276d8e7416e6', 'b9a444b2-3487-444f-9db9-94dbf21dcf9f', '1f48d23b-65fa-440f-98bc-718c10c5df05', 'dd32eeb0-7989-4177-817f-f33d799a4a43'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:54 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:54 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:54 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-40e0308b-0611-481b-be58-f1703915de9a" returned: 0 in 0.426s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-40e0308b-0611-481b-be58-f1703915de9a" released by "delete_volume" :: held 0.927s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Created reservations ['23fb2408-ca85-47be-8399-9e33bdd8825c', '2525d9fe-5836-4f82-91be-ff72b241149a', 'e07633df-203b-499a-96b8-b33b4334c0d5', '44f25d9c-ddb0-4285-b392-2132fef6da4e'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:54 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:54 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-c28f3999-e52d-43fc-be55-987aff27bc3d-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-c28f3999-e52d-43fc-be55-987aff27bc3d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "cinder-quobyte-c28f3999-e52d-43fc-be55-987aff27bc3d" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-c28f3999-e52d-43fc-be55-987aff27bc3d" acquired by "delete_volume" :: waited 0.014s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[906c047a-8f9f-4ca3-9ed1-cc69679ce2be]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:54 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.462s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:54 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Deleted volume successfully. Feb 26 03:36:54 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d76c4901-fe32-4fd1-999f-d9f97fbf1386 tempest-CreateVolumesFromSourceVolumeTest-1425547197 None] Lock "cinder-31a2a509-8634-42d2-81f3-9ee33145026a-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:54 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d Feb 26 03:36:54 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:55 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.550s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:55 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Deleted volume successfully. Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d385f82b-471e-43c2-8cbf-cb006ba91683 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-40e0308b-0611-481b-be58-f1703915de9a-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:55 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d" returned: 0 in 0.533s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:55 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d Feb 26 03:36:55 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:55 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-c28f3999-e52d-43fc-be55-987aff27bc3d" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-quobyte-c28f3999-e52d-43fc-be55-987aff27bc3d" released by "delete_volume" :: held 0.991s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Created reservations ['bab872ba-68b5-439a-8e1a-ac344944a542', '41a615e9-cab0-4dba-834b-0e841c5dc24e', '0e008d8c-7878-4cb6-9923-e8be4508ef59', 'a9d84e99-8976-4e93-b2f2-e40cb7b2dfb5'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:55 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:55 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:36:55 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Flow 'volume_create_manager' (734aaf87-2bb0-4624-808f-8d98a0bb5b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d859fc-5aa3-4726-9b10-194448860737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d859fc-5aa3-4726-9b10-194448860737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d02eca-b6b1-4560-b4a0-8287e832ec46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fe8c52e57446c3949adb6ada3a2c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:56Z,use_quota=True,user_id='7627398c9a3e4482875039e5cec90ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306a3030-2f39-468c-af4d-605d57975cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306a3030-2f39-468c-af4d-605d57975cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e8cac1-a7ec-4e8c-b0d1-fa32e6e2cd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e8cac1-a7ec-4e8c-b0d1-fa32e6e2cd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d02eca-b6b1-4560-b4a0-8287e832ec46', 'volume_name': 'volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae871088-b11d-4697-a618-a809450cfc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae871088-b11d-4697-a618-a809450cfc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0c1d6d-1e18-4490-b57b-faa247d4eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:56 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Volume f7d02eca-b6b1-4560-b4a0-8287e832ec46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46', 'volume_size': 1} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d02eca-b6b1-4560-b4a0-8287e832ec46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fe8c52e57446c3949adb6ada3a2c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:56Z,use_quota=True,user_id='7627398c9a3e4482875039e5cec90ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Creating volume f7d02eca-b6b1-4560-b4a0-8287e832ec46 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:56 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:56 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46 1073741824 Feb 26 03:36:56 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:56 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.420s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:36:56 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Deleted volume successfully. Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-516f9018-741d-46ae-af1d-87ab99482ff6 tempest-VolumeDependencyTests-1909018923 None] Lock "cinder-c28f3999-e52d-43fc-be55-987aff27bc3d-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:36:56 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46 1073741824" returned: 0 in 0.448s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:56 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46 Feb 26 03:36:56 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:56 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46" returned: 0 in 0.383s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0c1d6d-1e18-4490-b57b-faa247d4eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a9dee3-dc45-4f74-9e79-44014df92900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:56 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Volume volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46 (f7d02eca-b6b1-4560-b4a0-8287e832ec46): created successfully Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a9dee3-dc45-4f74-9e79-44014df92900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:56 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Flow 'volume_create_manager' (734aaf87-2bb0-4624-808f-8d98a0bb5b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:56 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-53d54c49-55a4-4a8b-a738-9aa2c502ab72 tempest-CinderUnicodeTest-1037358661 None] Created volume successfully. Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83121) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Flow 'volume_create_manager' (b3ff92ef-dfea-43c8-be3d-4e2a222b2e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a454a062-07fd-4d7f-a99d-d075c6ff7854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a454a062-07fd-4d7f-a99d-d075c6ff7854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1175971077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47a407d-d069-4ad6-a2a9-b53fc656deb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fe8c52e57446c3949adb6ada3a2c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:57Z,use_quota=True,user_id='7627398c9a3e4482875039e5cec90ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696cc4a5-22b5-4a96-ac39-48987b2c3eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696cc4a5-22b5-4a96-ac39-48987b2c3eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98b45a8-71a8-4cd7-adcb-d14a97fe668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98b45a8-71a8-4cd7-adcb-d14a97fe668d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f47a407d-d069-4ad6-a2a9-b53fc656deb6', 'volume_name': 'volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9ebb15-4183-450f-a9b4-31487e458cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9ebb15-4183-450f-a9b4-31487e458cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61aeb00-5d88-45dc-8fc7-d1a21f9daabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:57 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Volume f47a407d-d069-4ad6-a2a9-b53fc656deb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6', 'volume_size': 1} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T02:36:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1175971077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47a407d-d069-4ad6-a2a9-b53fc656deb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fe8c52e57446c3949adb6ada3a2c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T02:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T02:36:57Z,use_quota=True,user_id='7627398c9a3e4482875039e5cec90ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(607b4e0d-fc28-4056-92ed-7337127ea6d1),volume_type_id=607b4e0d-fc28-4056-92ed-7337127ea6d1)}" {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Creating volume f47a407d-d069-4ad6-a2a9-b53fc656deb6 {{(pid=83121) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Selected osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d as target Quobyte volume. {{(pid=83121) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 03:36:57 devstack cinder-volume[83121]: INFO cinder.volume.drivers.remotefs [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] casted to osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 1073741824 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:57 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 1073741824 Feb 26 03:36:57 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:57 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 1073741824" returned: 0 in 0.498s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:57 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:57 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 Feb 26 03:36:57 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:36:58 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Feb 26 03:36:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6" returned: 0 in 0.413s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:36:58 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'} {{(pid=83121) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 03:36:58 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:36:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61aeb00-5d88-45dc-8fc7-d1a21f9daabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6', 'volume_size': 1}' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2a0f0d-625d-490e-8884-fae58a249c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 03:36:58 devstack cinder-volume[83121]: INFO cinder.volume.flows.manager.create_volume [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Volume volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 (f47a407d-d069-4ad6-a2a9-b53fc656deb6): created successfully Feb 26 03:36:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2a0f0d-625d-490e-8884-fae58a249c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83121) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 03:36:58 devstack cinder-volume[83121]: DEBUG cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Flow 'volume_create_manager' (b3ff92ef-dfea-43c8-be3d-4e2a222b2e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83121) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 03:36:58 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-e7beb85e-b2b7-40db-b2ae-c62a07ece04d tempest-CinderUnicodeTest-1037358661 None] Created volume successfully. Feb 26 03:36:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:36:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:36:59 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Creating offline snapshot acdb5ad5-33e7-4910-9070-62922448f343 of volume f47a407d-d069-4ad6-a2a9-b53fc656deb6 {{(pid=83121) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 03:36:59 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[727fd9b5-7942-4399-8d26-d086c84fc168]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:36:59 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:36:59 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 Feb 26 03:36:59 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:00 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6" returned: 0 in 0.441s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 1G {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:00 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 1G Feb 26 03:37:00 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:00 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 1G" returned: 0 in 0.462s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:00 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 Feb 26 03:37:00 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:00 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 -F qcow2 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343" returned: 0 in 0.431s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:00 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 is being set with open permissions: ugo+rw Feb 26 03:37:00 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:00 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 Feb 26 03:37:01 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:01 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343" returned: 0 in 0.397s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:01 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.info Feb 26 03:37:01 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:01 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.info" returned: 0 in 0.404s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:01 devstack cinder-volume[83121]: WARNING cinder.volume.drivers.remotefs [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.info is being set with open permissions: ugo+rw Feb 26 03:37:01 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.info {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:01 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.info Feb 26 03:37:01 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:02 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.info" returned: 0 in 0.373s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.568s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=198,cinder:UPDATE=285,cinder:INSERT=75,cinder:DELETE=21 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:37:02 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-df4073d5-5de2-4a3f-becd-b2d053bf66dc tempest-CinderUnicodeTest-1037358661 None] Create snapshot completed successfully Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "cinder-acdb5ad5-33e7-4910-9070-62922448f343-delete_snapshot" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-acdb5ad5-33e7-4910-9070-62922448f343-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "cinder-quobyte-f47a407d-d069-4ad6-a2a9-b53fc656deb6" by "delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-quobyte-f47a407d-d069-4ad6-a2a9-b53fc656deb6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "cinder-quobyte-acdb5ad5-33e7-4910-9070-62922448f343" by "_delete_snapshot" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-quobyte-acdb5ad5-33e7-4910-9070-62922448f343" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Deleting offline snapshot acdb5ad5-33e7-4910-9070-62922448f343 of volume f47a407d-d069-4ad6-a2a9-b53fc656deb6 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] snapshot_file for this snap is: volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 {{(pid=83121) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e450bda-4dc0-41a9-bb6d-14c48a064b19]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:37:02 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:02 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 Feb 26 03:37:02 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:03 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343" returned: 0 in 0.427s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:03 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.remotefs [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83121) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 03:37:03 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4f0e25-1138-42a5-b89e-90c73abb2fcc]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:37:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:03 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 Feb 26 03:37:03 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:03 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6" returned: 0 in 0.434s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:03 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:03 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 Feb 26 03:37:03 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:04 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343" returned: 0 in 0.430s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:04 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343 Feb 26 03:37:04 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:04 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6.acdb5ad5-33e7-4910-9070-62922448f343" returned: 0 in 0.400s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:UPDATE=278,cinder:SELECT=203,cinder:DELETE=31,cinder:INSERT=58 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-quobyte-acdb5ad5-33e7-4910-9070-62922448f343" released by "_delete_snapshot" :: held 1.752s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-quobyte-f47a407d-d069-4ad6-a2a9-b53fc656deb6" released by "delete_snapshot" :: held 1.765s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Created reservations ['c6913843-243d-474f-b4a6-1753156f0cb9', '8b3fa1eb-21cc-48b0-b9e6-05e144e28ad2', '7afef92e-db3f-4281-9a67-4040bd09230f', 'e309126c-a8eb-4d06-842e-42fe40fa86c7'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:37:04 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Delete snapshot completed successfully. Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-d1057b79-1ff0-40c6-94f1-528bab471f08 tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-acdb5ad5-33e7-4910-9070-62922448f343-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "cinder-f47a407d-d069-4ad6-a2a9-b53fc656deb6-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-f47a407d-d069-4ad6-a2a9-b53fc656deb6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "cinder-quobyte-f47a407d-d069-4ad6-a2a9-b53fc656deb6" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-quobyte-f47a407d-d069-4ad6-a2a9-b53fc656deb6" acquired by "delete_volume" :: waited 0.007s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[20274dbd-6a9a-470c-9535-1bdd83da049d]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:37:04 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:05 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 Feb 26 03:37:05 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:05 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6" returned: 0 in 0.458s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:05 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6 Feb 26 03:37:05 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:05 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f47a407d-d069-4ad6-a2a9-b53fc656deb6" returned: 0 in 0.381s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-quobyte-f47a407d-d069-4ad6-a2a9-b53fc656deb6" released by "delete_volume" :: held 0.872s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Created reservations ['022e9559-097b-4ad7-bb5b-35c8336b3ba8', '626c4079-bfe0-4a30-b35f-e3df0c836e1d', '688facf1-e843-4650-9766-bc9037a2f339', '43a7938b-7dfd-4e4c-b6cd-f0fee7985fb9'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:37:05 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:05 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:37:05 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "cinder-f7d02eca-b6b1-4560-b4a0-8287e832ec46-delete_volume" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-f7d02eca-b6b1-4560-b4a0-8287e832ec46-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "cinder-quobyte-f7d02eca-b6b1-4560-b4a0-8287e832ec46" by "delete_volume" {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-quobyte-f7d02eca-b6b1-4560-b4a0-8287e832ec46" acquired by "delete_volume" :: waited 0.008s {{(pid=83121) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83bbdbc-cef5-4fbe-8230-69453d401cfb]: (4, 'qcow2') {{(pid=83827) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:06 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46 Feb 26 03:37:06 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:06 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.433s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:37:06 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Deleted volume successfully. Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-3abb6fa6-79e6-476c-8c71-a671852c5e0f tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-f47a407d-d069-4ad6-a2a9-b53fc656deb6-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:37:06 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46" returned: 0 in 0.491s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46 {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:06 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46 Feb 26 03:37:06 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:06 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d/volume-f7d02eca-b6b1-4560-b4a0-8287e832ec46" returned: 0 in 0.403s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:06 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-quobyte-f7d02eca-b6b1-4560-b4a0-8287e832ec46" released by "delete_volume" :: held 0.919s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:37:07 devstack cinder-volume[83121]: DEBUG cinder.quota [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Created reservations ['58581c19-686a-4022-86e1-d7a51118588a', '858c430d-ac42-439d-a453-ae7fbfd2f43c', 'e2bbfbf6-10d7-41ff-8a0f-55d91506f55c', 'e77e8cff-4470-4cda-957a-3eb5db61ee58'] {{(pid=83121) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 03:37:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 03:37:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 03:37:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d': None} {{(pid=83121) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 03:37:07 devstack cinder-volume[83121]: DEBUG cinder.volume.drivers.quobyte [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910ecf8d-c26a-43b9-84a4-7012df48241d'] {{(pid=83121) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 03:37:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.lockutils [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 03:37:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 03:37:07 devstack sudo[91915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d Feb 26 03:37:07 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 03:37:07 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root Feb 26 03:37:07 devstack cinder-volume[83121]: DEBUG oslo_concurrency.processutils [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/074715da469c36833bbd25a93d59ee6d" returned: 0 in 0.485s {{(pid=83121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 03:37:07 devstack cinder-volume[83121]: DEBUG cinder.manager [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Notifying Schedulers of capabilities ... {{(pid=83121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 03:37:07 devstack cinder-volume[83121]: INFO cinder.volume.manager [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Deleted volume successfully. Feb 26 03:37:07 devstack cinder-volume[83121]: DEBUG cinder.coordination [None req-c9cd0be8-7c98-4760-aea5-b665835da077 tempest-CinderUnicodeTest-1037358661 None] Lock "cinder-f7d02eca-b6b1-4560-b4a0-8287e832ec46-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=83121) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 03:37:17 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 03:37:17 devstack cinder-volume[83121]: DEBUG dbcounter [-] [83121] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=83121) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}